-- Logs begin at Thu 2022-05-26 11:44:20 UTC, end at Thu 2022-05-26 13:04:02 UTC. -- May 26 12:23:01.392130 dv-cinder-819667-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 12:23:01.403102 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:23:01 2022] *** May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: nodename: dv-cinder-819667-4-iscsi May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: machine: x86_64 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: clock source: unix May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: pcre jit disabled May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: detected number of CPU cores: 4 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: current working directory: / May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: detected binary path: /usr/bin/uwsgi-core May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: your processes number limit is 47680 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: your memory page size is 4096 bytes May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: detected max file descriptor number: 2048 May 26 12:23:01.406815 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: lock engine: pthread robust mutexes May 26 12:23:01.407609 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: thunder lock: enabled May 26 12:23:01.407609 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 12:23:01.407609 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:23:01.451122 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: Python main interpreter initialized at 0x5565b27449c0 May 26 12:23:01.451122 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: python threads support enabled May 26 12:23:01.451122 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: your server socket listen backlog is limited to 100 connections May 26 12:23:01.451122 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: your mercy for graceful operations on workers is 90 seconds May 26 12:23:01.451442 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:23:01.451514 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: *** Operational MODE: preforking *** May 26 12:23:01.451827 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: *** uWSGI is running in multiple interpreter mode *** May 26 12:23:01.451827 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: spawned uWSGI master process (pid: 80213) May 26 12:23:01.452048 dv-cinder-819667-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 12:23:01.454995 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: spawned uWSGI worker 1 (pid: 80217, cores: 1) May 26 12:23:01.454995 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: spawned uWSGI worker 2 (pid: 80218, cores: 1) May 26 12:23:01.454995 dv-cinder-819667-4-iscsi devstack@keystone.service[80213]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:23:07.048113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:07.048113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes May 26 12:23:07.048895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:07.048895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes May 26 12:23:07.059307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:07.059307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: from cryptography.utils import int_from_bytes May 26 12:23:07.059863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:07.059863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: from cryptography.utils import int_from_bytes May 26 12:23:07.097000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:07.097154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:07.097357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] command line args: [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:07.097618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:07.097749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ================================================================================ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:07.098025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.098278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_dir = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.098417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.098620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_source = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.098751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] debug = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.098974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.099291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.099491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.099745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.099985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.100304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.100417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_config_append = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.100533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.100692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_dir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.100863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.101107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.101327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.101591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.101817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.101974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.102146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.102382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.102622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.102849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.103077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.103302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.103524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.103781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.104021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.104286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.104765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.104944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] publish_errors = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.105333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.105570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.105750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.105990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.106222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.106453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] standard_threads = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.106684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.106922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_journal = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:07.107420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_json = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:07.107612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_stderr = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] command line args: [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:07.107764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_syslog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.107945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:07.108022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.108123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ================================================================================ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:07.108224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.108387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] admin_token = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.108465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.108633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] config_dir = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.108712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.108822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.108901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.109008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] config_source = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.109146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.109225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] debug = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.109381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.109494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.109624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.109702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.109815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.109904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.110069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.110307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.110390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.110535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.110617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.110700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_config_append = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.110777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.110878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.111016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.111105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_dir = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.111214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.111293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.111451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.111528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.111715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.111808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.111947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.112031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.112195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.112274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.112374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.112463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.112557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.112669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.112801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.112885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.113044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.113129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.113277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.113376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.113511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.113622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.113744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.113861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.113975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.114088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.114220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.114298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.114463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.114542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.114734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.114813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.114978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.115217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.115371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.115453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] publish_errors = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.115523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.115643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.115733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.115874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.115952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.116051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.116129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.116296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.116383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.116530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.116609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.116763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] standard_threads = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.116840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.117359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.117447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.117596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.117678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.117755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.117831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.117929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] use_journal = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.118015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.118088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] use_json = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.118240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.118324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] use_stderr = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.118424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] use_syslog = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.118506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.118654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:07.118733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.118910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.118989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.119916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.120784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.121983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.122915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.123868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.124991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.125921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.126923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.127879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.128959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.129943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.130849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.131949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.external = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.132943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.password = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.token = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.133874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.134953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.135039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.135191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.135276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.135418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.135503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.137982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.138799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.139997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.140941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.141954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.142885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.143983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.144921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.external = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.145915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.password = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.token = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.146874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.147986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.148989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.149958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.150899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.151895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.152915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.153935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.154938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.155944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156184 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.156960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.157856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.158957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.159983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.160912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.161995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.162930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.163982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.164955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.165898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.166980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.167894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.168842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.169953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.170895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.171898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.172967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.173995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.174915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175778 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.175857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.176957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.177968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] role.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] role.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.178907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.179953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.180939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.181953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.182982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.183068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.183336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:07.183419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.184101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.184361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.184605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.184868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.185129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.185387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.185625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.185861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.186098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.186354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.186611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.186862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.187101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.187340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.187596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.187836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.188074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.188322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.188560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.188814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.189060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.189295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.189540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.189782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.190029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.190265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.190502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.190735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.190978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.191224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.191452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.191731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.192020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.192277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.192528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.192769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.193008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.193248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.193483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.193720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.193955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.194189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.194432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.194667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.194909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.195144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.195389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.195654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.195899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.196128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.196367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.196601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:07.196770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:07.214232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.214565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.214792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.223326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.223995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.224259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.224455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.233232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.251818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.252087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.254434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.254665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.303859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.304784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.353881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.354075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.356665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.356904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.418600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.418849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.419938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.420186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.420411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.420634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.420858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.442997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.443852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.454753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.455724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.467220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.467428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.467798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.467878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.467945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.468963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.469205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:07.487224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.487398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:07.487789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.487912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:07.488082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:07.488220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:07.488707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.488977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.489103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.489275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.489531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.500544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.500779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.501068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.501344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.501485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.501703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.501945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.502252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.509369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.510341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.512823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.513096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.513368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.513645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.513921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.514264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.514920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.515755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.516154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.516404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.516670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.516934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.541760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.543381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.543783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.543906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.545444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.545828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.549021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.549294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.549565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.551093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.551374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.551674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.556843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.557054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.559592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.559904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.561744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.562023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.562300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.562692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.562963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.563230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.563494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.563782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.564374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.564661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.564941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.565311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.565585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.565862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.566129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.566401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.582310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.582581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.585545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.585826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.587232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.590683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.590992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.591283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.594346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.594645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.596315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.599730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.599854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.603302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.603428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.603788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.604173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.604453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.604733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.605070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.607567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.607903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.608251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.608533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.608818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.609101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.624288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.624561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.624809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.625049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.628845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.629122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.629388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.629654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.633110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.634788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.635063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.638155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.638278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.638472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.638706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.638974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.639243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.639888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.640181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.643205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.643492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.643809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.644091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.644366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.652778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.653051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.653327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.653610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.653886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.654155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.654432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.658315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.658596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.658870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.659148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.659422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.659733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.660006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.672353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.675744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.678318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.678972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.680576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.681709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.682176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.682455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.682724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.685593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.687200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.688866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.689148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.689426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.690042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.691742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.695001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.695289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.695562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.695855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.696783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.698412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.702728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.703015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.703294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.703572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.704894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.705160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.705443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.712654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.712936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.713213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.713339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.713613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.713886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.714153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.714481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.714898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.715199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.715497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.715791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.716055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.716300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.716554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.716817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.717079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.721803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:07.722107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.722387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.722719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.722914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.723187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.723458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.723752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.724029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.724298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.724549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.724821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.725087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.725351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:07.756309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565b27449c0 pid: 80217 (default app) May 26 12:23:07.759523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe63d1-914d-43ca-97ee-9ebc07f76ae3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:07.759831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe63d1-914d-43ca-97ee-9ebc07f76ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:07.760107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe63d1-914d-43ca-97ee-9ebc07f76ae3 None None] PATH_INFO: `/v3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:07.764570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Thu May 26 12:23:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:07.765767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565b27449c0 pid: 80218 (default app) May 26 12:23:15.743161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.744115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.744115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.746130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:15.753713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.754151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.754236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.821426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: INFO dbcounter [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] Registered counter for database keystone May 26 12:23:15.846015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG oslo_db.sqlalchemy.engines [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:15.857290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writer thread running {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:16.050734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG passlib.handlers.bcrypt [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80218) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:23:16.051066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG passlib.handlers.bcrypt [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80218) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:23:16.108029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:16.109640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:16.240950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1/3] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:23:16.425699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:16.498357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: INFO dbcounter [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] Registered counter for database keystone May 26 12:23:16.519487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG oslo_db.sqlalchemy.engines [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:16.529503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writer thread running {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:16.649951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce4b1-1b13-4cdd-8411-f9479ae679c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:16.658063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:16.659133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:16.659616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:16.660113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:16.672304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:16.724268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:23:16.724602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361d2c9-deb9-46c7-8904-f2488f6967ed admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:16.735247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1324 bytes} [Thu May 26 12:23:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:23:16.742858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:16.764418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e0eb1-6713-46ba-8376-bb93443bbf07 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:16.769423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:16.770549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:16.770829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:16.771096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] PATH_INFO: `/v3/projects/f7b62d8bc2904e559160e9d978cde596` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:16.772792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7b62d8bc2904e559160e9d978cde596)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:16.937032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:23:16.937366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd399-fe00-41db-80c9-c9ae9bf44935 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:16.942219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 2/5] 10.222.0.75 () {56 vars in 1207 bytes} [Thu May 26 12:23:16 2022] GET /identity/v3/projects/f7b62d8bc2904e559160e9d978cde596 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.123751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf23c-f8b8-4ba4-bec9-4863441bfb9f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.124266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf23c-f8b8-4ba4-bec9-4863441bfb9f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.124266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbf23c-f8b8-4ba4-bec9-4863441bfb9f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.128447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 4/6] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:19.135249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.135790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.135961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.157900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:19.159406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:19.169501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 3/7] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:23:19.202834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbf23c-f8b8-4ba4-bec9-4863441bfb9f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.218367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbf23c-f8b8-4ba4-bec9-4863441bfb9f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.223737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.224374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.224653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.224924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.232705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.234494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c209d00-e114-458c-b6a1-02fc6a308096 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.243392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 5/8] 10.222.0.75 () {58 vars in 1324 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:23:19.251352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.260412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5d9ad-b8f4-46d3-a6c6-2898537f44cc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.265368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.266227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.266499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.266762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.268233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.270053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143e391-f973-4668-b10d-588a21759774 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.271619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 4/9] 10.222.0.75 () {56 vars in 1198 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.513738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ccaeb-1972-4ec6-87ce-8f1f26b0cf7a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.514287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ccaeb-1972-4ec6-87ce-8f1f26b0cf7a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.514378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ccaeb-1972-4ec6-87ce-8f1f26b0cf7a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.515819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:21.521203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.521647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.521751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.531347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea7-647c-44f6-b33a-6c2ed735616b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.531664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea7-647c-44f6-b33a-6c2ed735616b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.531939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea7-647c-44f6-b33a-6c2ed735616b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.533264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 7/11] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:21.538309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.538571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.538848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.539583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:21.540765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:21.580876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80217) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:23:21.581279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80217) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:23:21.622705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 5/12] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:21.627563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:21.629187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:21.645567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.669994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.733682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 8/13] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:21.752524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54708943-2d44-4bd4-a732-8a4d022b3ee6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.756235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.793134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.793970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.794255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.794531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.808753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:21.820284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:21.821323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:21.822116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 6/14] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:21.829204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.916531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.934738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f8d-0d2b-4f68-862d-fe2a09bba892 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.968324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.968990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.969268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.969542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.970291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:21.970431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f22c-d70d-401c-9e24-d31b432fbfca None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.970603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.972034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.973634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.984084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 7/15] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.989917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.010538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.011504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.011813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.012085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.078271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.079859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.089192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ee24-8e8f-42af-bbe5-b29ce1aa7e14 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.123593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.124476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.124760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.125035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.126253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.127762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.129422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 8/16] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:22.135033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.149770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:22.174813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 9/17] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:23:22.180354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.183245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:22.235428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe8fe-09cf-40a0-8a10-f034be5678e8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.269350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.270143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.270426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.270705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.272023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.273526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.275151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 9/18] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:22.279738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8524-efc4-41d2-9601-ca133396a56a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.281011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.314353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.315150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.315431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.315733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.334648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.336126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:23:22.357384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:22.358267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:22.359056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:23:22.359056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:23:22.359056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:22.359056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:22.359056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 10/19] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:22.360814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:22.364958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.380453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16e715-b06e-4167-b5fd-a6ada859796a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.413008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.413659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.413943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.414207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.415034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.domain.id=default, user.id=801932a0f57f4075beaa7d9bf3b3839f) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:22.415344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.417061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562655d-1c01-4809-9674-1360330ff0af None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.423719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 10/20] 10.222.0.75 () {56 vars in 1322 bytes} [Thu May 26 12:23:22 2022] GET /identity/v3/role_assignments?user.id=801932a0f57f4075beaa7d9bf3b3839f&scope.domain.id=default&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:22.423850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:22.476044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746f3e-f285-4a8a-84f3-3f5b2dc45b07 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.519238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.520007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.520232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.520508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.521257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:22.521569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.523011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f3f-6011-42f6-91f2-56bed0d9b6fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.542970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 11/21] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.875396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0f85-dafc-4835-b00f-f19e24ff3f70 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.876323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0f85-dafc-4835-b00f-f19e24ff3f70 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.876751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0f85-dafc-4835-b00f-f19e24ff3f70 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.878264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 11/22] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:24.883903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d38-6c40-445f-a5ed-16b68cd19d84 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.884731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d38-6c40-445f-a5ed-16b68cd19d84 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.885240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d38-6c40-445f-a5ed-16b68cd19d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.916939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-aaf32d38-6c40-445f-a5ed-16b68cd19d84 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:24.918387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aaf32d38-6c40-445f-a5ed-16b68cd19d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:25.009208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 12/23] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:25.035960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0f85-dafc-4835-b00f-f19e24ff3f70 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.184412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0f85-dafc-4835-b00f-f19e24ff3f70 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.236271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.237326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.237749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.238161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.250777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34d69-0983-4e64-acd5-1f9a9727a522 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.251203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34d69-0983-4e64-acd5-1f9a9727a522 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.251607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34d69-0983-4e64-acd5-1f9a9727a522 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.251769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:25.253346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:25.260044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:25.260881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:25.261855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:25.268038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 12/25] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:25.269685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.270077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.270455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.273751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.279859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.297080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:25.298440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:25.382745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.424870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 14/26] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:25.465085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.539068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4b875-68b8-4972-9cf5-3261486f6d42 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.601206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.601887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.602165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.602438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.603333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:25.603735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.605311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.619008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 13/27] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:25.625142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.715698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77984f09-3078-49e9-afd9-9a115e99a37a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.731085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.760068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.761405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.761688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.761959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.774625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f8ad8-4baf-4268-8f0d-aaeee72a3459 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.779344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.780903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a6d438c1-4fe1-46b2-8850-79ab728bf090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:23:25.809257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:25.810409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 15/28] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:25.811838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0136a-e9cc-4b01-b218-9720e997d7e4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.812428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0136a-e9cc-4b01-b218-9720e997d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.812428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0136a-e9cc-4b01-b218-9720e997d7e4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 16/29] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eec03-a133-44d7-a4cd-d9a7ab029b1c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eec03-a133-44d7-a4cd-d9a7ab029b1c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eec03-a133-44d7-a4cd-d9a7ab029b1c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 17/30] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:25.819984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eec03-a133-44d7-a4cd-d9a7ab029b1c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.830540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.831729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.832176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.832668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.834096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.836012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e2e83-da2b-4174-9e20-45ce2b2fb243 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.837878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 14/31] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:25.839304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6e75-2cb9-4c28-b1ae-9957c17df8b3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.839846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6e75-2cb9-4c28-b1ae-9957c17df8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.840339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6e75-2cb9-4c28-b1ae-9957c17df8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.858436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-93ec6e75-2cb9-4c28-b1ae-9957c17df8b3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:25.859893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-93ec6e75-2cb9-4c28-b1ae-9957c17df8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:25.868114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.933808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 15/32] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:25.935718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.936011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.936335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.955579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:25.956985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:25.981897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eec03-a133-44d7-a4cd-d9a7ab029b1c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.019598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.020687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.021189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.021722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.022620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:26.023105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.025026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.030764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.039869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 18/33] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:26.044530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 16/34] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:26.045635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.047231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.161029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.175892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fac2a-85e3-46a9-914a-e15b3def4e5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.205744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be40031-d26e-49eb-89fe-f1896c46b7ff None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.233462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.234488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.235207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.235679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.237615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.239260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.245038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.246075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.246754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.247292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.248724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.251029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.252825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 17/35] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:26.253567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.318891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.364744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca226b5-a09a-4e7c-82e0-89efd3ccea24 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.399909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 19/36] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/roles => generated 219 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:26.401346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.406033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.407161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.407674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.408122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.409109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.411211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d14a4-f0e7-48c7-9a56-9230aad3c5f3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.550311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7dbc-fbcc-44f0-93b6-6dab3fe248f2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.587938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.588687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.589106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.589394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.590163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.594760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.611125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 20/37] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:26.611967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.626304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.653177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 18/38] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:26.659605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c74d-c9d0-4b2f-bc58-6c75bb0d189c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.659605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c74d-c9d0-4b2f-bc58-6c75bb0d189c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.659605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c74d-c9d0-4b2f-bc58-6c75bb0d189c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.659605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 19/39] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:26.671609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.671609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.671609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.727582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:26.727582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:26.796123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd9cd-7862-4007-8ec9-394e2e10b68b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.843854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.845133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.845576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.845992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] PATH_INFO: `/v3/domains/default/users/801932a0f57f4075beaa7d9bf3b3839f/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.849641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=801932a0f57f4075beaa7d9bf3b3839f, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.851416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005eb4-264a-4a45-bb79-7c41504e8a23 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.877487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 21/40] 10.222.0.75 () {58 vars in 1361 bytes} [Thu May 26 12:23:26 2022] PUT /identity/v3/domains/default/users/801932a0f57f4075beaa7d9bf3b3839f/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:26.898586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981f62-c7ef-499a-a86b-19668754c79f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.898792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981f62-c7ef-499a-a86b-19668754c79f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.899071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981f62-c7ef-499a-a86b-19668754c79f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.904514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 22/41] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:26.917356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.917645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.917879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 20/42] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:26.917981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.936914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:26.938547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:26.954148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.031079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.034492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.041086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 23/43] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:27.065935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.102246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda7d5-16cb-42bd-b2d7-4e213ee3c903 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.142764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.143448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.143766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.144044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.144802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.146358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.162730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 21/44] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/roles => generated 223 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:23:27.182888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22636aa3-db85-487e-aff4-330a5c2b4c16 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.221738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.222572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.222834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.223130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.224533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.226053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b24af-ab12-42d2-b1d4-74edf3afa1ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.228067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 24/45] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:27.234076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.345422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2ccd-eb77-4304-8390-89ea052ae49e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.349402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.386577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.387170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.387448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.387776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.388520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.390056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd6c-bdcf-4abd-9615-a88b959918a6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.419241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 22/46] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:23:27 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:29.115642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a93e-cdca-4b3b-acfa-dbf4e0045fe0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.116173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a93e-cdca-4b3b-acfa-dbf4e0045fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.116173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a93e-cdca-4b3b-acfa-dbf4e0045fe0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.117535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 25/47] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:29.123155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.123580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.123752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.141730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:29.142937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:29.213271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 23/48] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:29.236498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7a93e-cdca-4b3b-acfa-dbf4e0045fe0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.306097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.345282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7a93e-cdca-4b3b-acfa-dbf4e0045fe0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.380789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.381517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.381804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.382082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.394030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:29.403238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:29.404108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:29.404882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 26/49] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:29.410582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.508486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.527137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91050ab-0768-40a4-b6a8-cd89db0ea42f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.561294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.561959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.562243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.562518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.563280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:29.563611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.565019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46297a5-5e5a-4637-adba-5741a4122d62 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.573058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 24/50] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.578778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.629878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d31b-32ed-4acb-9a41-01e52e2fc4b2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.630161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d31b-32ed-4acb-9a41-01e52e2fc4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.630437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d31b-32ed-4acb-9a41-01e52e2fc4b2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.631906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 25/51] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:29.637250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.637602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.637988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.654983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:29.656214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:29.682249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff3ab-0c93-465b-9315-61aaf544c2a2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.707459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.717005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.717982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.718256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.718737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.719762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.721240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.722968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 26/52] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:29.723072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 27/53] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:29.728305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.745474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.808021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.829744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7db9e-f21b-4ade-aea2-848319a142e2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.846204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb8571-3a30-4bbe-97fa-6a0183bad1f2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.862585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.863394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.863705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.863980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.865521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.867001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.873345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 27/54] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.874378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.880141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.880946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.881227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.881499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.882723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.884312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.885956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 28/55] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:29.891254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.953324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.975780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfa13a-3559-4d41-992a-627e69f258e1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.991924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b504-ab99-4a68-bddb-f0aa10aea715 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.009897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.010532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.010800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.011097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.011958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.domain.id=default, user.id=801932a0f57f4075beaa7d9bf3b3839f) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:30.012334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.013816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654e84-ec42-48ff-aae5-53bc96d88473 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.035573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 28/56] 10.222.0.75 () {56 vars in 1322 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/role_assignments?user.id=801932a0f57f4075beaa7d9bf3b3839f&scope.domain.id=default&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:30.035833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.035833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.035833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.035833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.036136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.036136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245734a-075c-4331-807d-c76151c41bb4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.060985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 29/57] 10.222.0.75 () {60 vars in 1140 bytes} [Thu May 26 12:23:29 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:32.260843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9956-417d-4b0d-985c-a7462fbb9f2e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.261725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9956-417d-4b0d-985c-a7462fbb9f2e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.261835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9956-417d-4b0d-985c-a7462fbb9f2e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.264213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 29/58] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:32.270543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.271209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.271476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.291459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:32.292678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:32.363884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 30/59] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:32.397002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e9956-417d-4b0d-985c-a7462fbb9f2e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.420099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.545275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e9956-417d-4b0d-985c-a7462fbb9f2e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.580615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.581415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.581699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.581973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.583278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:32.584785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba391a1-2e98-4e5c-82a0-c04feeac284e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:32.586453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 30/60] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:32.595151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.641315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.705526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1564df-bb90-4502-bb97-96523a11cfce None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.741214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.741890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.742174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.742451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.743174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:32.745059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312af2-571b-40dc-9bdd-d2a527f72ea5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:32.772945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 31/61] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:32 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:35.924081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443688e-8eee-4da2-942b-b5f637921463 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.925088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443688e-8eee-4da2-942b-b5f637921463 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.925558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443688e-8eee-4da2-942b-b5f637921463 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.927131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 31/62] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:35.932880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.933316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.933440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.956589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:35.958024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:36.044571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 32/63] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:36.079631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443688e-8eee-4da2-942b-b5f637921463 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.197488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.227400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443688e-8eee-4da2-942b-b5f637921463 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.285606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.286425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.286709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.286975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.301956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f28d7548-d63a-438c-a408-33c25ff4ea91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:36.310124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:36.311061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:36.311853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 32/64] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:36.317198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.325019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff660-b20c-4098-aa7d-a36a568d4320 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.325167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff660-b20c-4098-aa7d-a36a568d4320 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.325353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff660-b20c-4098-aa7d-a36a568d4320 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.326763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 33/65] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:36.336713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5964e8-12f7-4496-947b-f630bbccecd0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.336998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5964e8-12f7-4496-947b-f630bbccecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.337275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5964e8-12f7-4496-947b-f630bbccecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.361308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.368584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4b5964e8-12f7-4496-947b-f630bbccecd0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:36.369838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b5964e8-12f7-4496-947b-f630bbccecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:36.436973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b200-9462-4112-bd3b-a8fb3e55d200 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.472985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 34/66] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:36.474749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159715-d94f-4c63-bcc8-2f212e11d22d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.475197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159715-d94f-4c63-bcc8-2f212e11d22d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.475685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159715-d94f-4c63-bcc8-2f212e11d22d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.477127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 35/67] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:36.480988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.481922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.482372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.482808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.483804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:36.484367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.485713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.486160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.486604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.489880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.511892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 33/68] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.512823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:36.513299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.514259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:36.596128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.603114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 36/69] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:36.608895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.623918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.626479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70d6d9-d80d-4425-a15e-f3cb45f13a86 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.664970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.665796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.666090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.666346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.676814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d681e2c8-1e04-47f4-aa76-1c384d074513 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:36.685231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:36.686093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:36.686860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 34/70] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:36.687716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b56c2-2a82-4214-bfae-6ff9313a2822 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.688146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b56c2-2a82-4214-bfae-6ff9313a2822 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.688563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b56c2-2a82-4214-bfae-6ff9313a2822 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.690034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 35/71] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:36.694522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b56c2-2a82-4214-bfae-6ff9313a2822 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.734005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c0f82-e86f-420e-8568-5b65f6dd84b3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.773942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.774858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.775191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.775463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.795125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.796703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.798603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 37/72] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.799374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.810636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b56c2-2a82-4214-bfae-6ff9313a2822 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.843152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.844003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.844282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.844532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.854297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.854962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e4b5e040-0ad6-4447-a707-6e10b970d7ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:36.862527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:36.863602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:36.869595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.870265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.870265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.882852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:36.884115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:36.891452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.900630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069949d-d29a-49e3-86bd-22b04c5ac0bc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.936103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.936774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.937041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.937319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.938047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:36.938347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.939772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05856520-64bc-409f-8107-1635499aa8bc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.948083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 38/74] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.951098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 37/75] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:36.951098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.955680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7f11-3859-4136-8024-e179ac22f150 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.955680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7f11-3859-4136-8024-e179ac22f150 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.955680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7f11-3859-4136-8024-e179ac22f150 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.955680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 39/76] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:36.955680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7f11-3859-4136-8024-e179ac22f150 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.057335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8abf67-fdc2-4c01-8035-644cb0c0354d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.059564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7f11-3859-4136-8024-e179ac22f150 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.077852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.092804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.093460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.093767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.094044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.094850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.095521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.095847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.096121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.096879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:37.097187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.098619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.106739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 40/77] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.107175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.107432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.164972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.166573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.206406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae318b-7b0f-4659-b582-5c8f96ea9df4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.239071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.240008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.240291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.240565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.241803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.243292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677c472-6af0-4d8c-9116-a0a9628be15a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.245197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 41/78] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.246480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.246769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.247047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.263216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:37.264455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:37.268544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 38/79] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:37.269374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.306851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.313952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.331560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 42/80] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:37.332202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.383421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef3538-a121-4720-ab90-6169f35014fe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.417491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.418292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.418578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.418854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.428792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:37.432688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956f3e6-8d74-451d-8637-9b65659d9a75 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:37.436739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:37.437709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:37.438488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 39/81] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:37.439102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.470641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.471526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.471833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.472106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.473308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.474785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.476458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 43/82] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.477209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.522361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.539807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbfd51-828f-47da-9b54-0091c007b507 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.541322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.573904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.574495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdf132-3c01-4306-858f-26957ff0a433 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.574594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.574827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.575100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.607946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.608814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.609097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.609369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.610595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.612092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.613810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 44/83] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.614930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.642962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.644415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.715884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1385df1-f781-42c3-b85f-06952fe0450a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.730376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.750041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 40/84] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:37.750041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.750041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.753451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.754253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.754531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.754800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.755985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.757440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.759062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 45/85] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.759886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.844634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff360-9f4f-42af-9964-14640e1b0d54 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.859191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5737-72c6-421a-bcd2-076b45f5ca47 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.880617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.881263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.881578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.881859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.882612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:37.882922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.884511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.892523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 41/86] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.892647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.893374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.893489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.893562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.893855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.943647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.961646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.962074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.963656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.000643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700882-668b-46a1-969e-6c0d77ed277a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.035042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.035731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.036016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.036288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.037185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:38.037498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.038960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.046582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 42/87] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.047366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.066649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 46/88] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:38.067553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.176287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127e27-32bd-4e04-92a3-d52b65671d1c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.184583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.205405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.207821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb6696-c8a4-4498-9473-8eb92e525f80 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.215094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.216054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.216389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.216681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.218004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.219493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.221346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 43/89] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.222156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.253464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.254132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.254435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.254699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.255417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.256974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.295238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 47/90] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:38 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:38.295238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.350707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b3a02-9541-4f0d-a8d7-51751aec4234 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.391655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.392774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.393247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.393726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.395230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.396691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314015e-662f-415c-be83-d684c8f726bf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.397043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.400111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 44/91] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.400734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.434710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.435513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.435840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.436124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.437360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.438859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.440651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 48/92] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.441431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.451491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.493197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.547118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e89-0213-4c75-8488-6363ff4aec5f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.568896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7afdad-f084-4db8-bf01-be496701e855 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.584978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.585792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.586123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.586439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.587504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:38.589143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.591085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.598627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 45/93] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.599891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.623875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.624564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.624850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.625131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.721831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.724146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.734240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a610-14f8-4d6c-a773-5dbb789abc7c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.735277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.777656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.792190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.792950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.793242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.793697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.796918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=801932a0f57f4075beaa7d9bf3b3839f) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:38.796918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.796918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.804661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 46/94] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/role_assignments?user.id=801932a0f57f4075beaa7d9bf3b3839f&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.873438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 49/95] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:38.880407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.995317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5815ced-03a4-47a2-8f56-3f560bca9799 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.040508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.041438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.041724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.042001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] PATH_INFO: `/v3/projects/6b0e0b9e53e54fbba6f881b67161799a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.043381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] RBAC: Authorizing `identity:get_project(project_id=6b0e0b9e53e54fbba6f881b67161799a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.044898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fabbd6-7505-4297-8414-d3246f82ec28 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.046837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 47/96] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/projects/6b0e0b9e53e54fbba6f881b67161799a => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:39.052510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.199882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92a1-8fd2-4a4d-ba8d-a975cb1d9bb4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.208128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.242987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.243724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.244010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.244289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.245131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=6b0e0b9e53e54fbba6f881b67161799a, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:39.245497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.246927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc43e-6aa5-484b-a4c5-03f61a4e934e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.255947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 50/97] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=6b0e0b9e53e54fbba6f881b67161799a&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:40.871236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d6218-8c0c-45ce-acf6-bec604358e6b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.872290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d6218-8c0c-45ce-acf6-bec604358e6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.872763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d6218-8c0c-45ce-acf6-bec604358e6b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.874384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 48/98] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:40.879970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.880760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.881227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.898408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:40.899963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:40.978628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 51/99] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:41.001990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d6218-8c0c-45ce-acf6-bec604358e6b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.064973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.107465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d6218-8c0c-45ce-acf6-bec604358e6b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.141765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.142578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.142862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.143140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.154000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:41.161645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:41.162566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:41.163325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 49/100] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:41.184708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.309870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.313535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba289b2c-0329-4237-bbf0-d5cd28f23d25 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.356553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.357231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.357566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.357845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.358631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:41.358936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.360441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.376458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 52/101] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:41.382242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.490638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aaaf6-f093-4af0-845e-20e7dcda2760 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.511477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.526750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.527702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.527982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.528257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.529474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.530946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524e43-16a3-4563-a851-11bbfe39d988 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.533103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 50/102] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:41.539105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.650628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c2dd-1641-4e1d-91a6-16c2a1b3230a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.650811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c2dd-1641-4e1d-91a6-16c2a1b3230a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.651097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c2dd-1641-4e1d-91a6-16c2a1b3230a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.652653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 51/103] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:41.660640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.660978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.661204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.683924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:41.685119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:41.706782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047debc-ed43-4a72-b576-277bfdc2d0b4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.747900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.749182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.749470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.749746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.751253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.752868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.759872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 53/104] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:41.762078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.821185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.831937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 52/105] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:41.885034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.943767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce7cd-ae4b-4e88-8a53-aee1064e5765 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.016745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.017988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.019526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.019991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/650134ee12184024a2141ce2785d0e53/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.024031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, user_id=650134ee12184024a2141ce2785d0e53, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.028692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db8468-11b3-4f23-aa68-b0b48f4b9f44 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.059563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 54/106] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:41 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/650134ee12184024a2141ce2785d0e53/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:23:42.083723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374609-69be-49eb-b7ef-bc5c5f7f2da4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.106223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.124959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2866e3-3b34-42fa-b91e-455eb15f4c92 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.125605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2866e3-3b34-42fa-b91e-455eb15f4c92 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.126202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2866e3-3b34-42fa-b91e-455eb15f4c92 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.128030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 55/107] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:42.132427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.134417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.134920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.135387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.135642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338326a0-65db-4b56-b799-7e8efd61dbb3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.135938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338326a0-65db-4b56-b799-7e8efd61dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.136222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338326a0-65db-4b56-b799-7e8efd61dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.157332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-338326a0-65db-4b56-b799-7e8efd61dbb3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:42.158710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:42.159673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-338326a0-65db-4b56-b799-7e8efd61dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:42.167905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:42.168827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:42.169577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:42.172228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 53/108] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:42.178284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.272123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 56/109] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:42.315248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d9a5-e0cb-47e2-b343-1dd376703870 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.315609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d9a5-e0cb-47e2-b343-1dd376703870 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.318990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d9a5-e0cb-47e2-b343-1dd376703870 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.320857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 57/110] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:42.326705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cec09-fa54-49ff-920e-5f661ae40f33 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.327120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cec09-fa54-49ff-920e-5f661ae40f33 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.327321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cec09-fa54-49ff-920e-5f661ae40f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.365159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ff6cec09-fa54-49ff-920e-5f661ae40f33 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:42.366503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff6cec09-fa54-49ff-920e-5f661ae40f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:42.387826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.394091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e614d-988a-4bec-b759-3ffc1c644d61 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.434135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.434990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.435516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.436151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.436934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:42.437244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.439262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.451755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 54/111] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.452449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.458535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 58/112] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:42.464121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af431-7431-4b6f-a049-4d77aa727ef2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.464428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af431-7431-4b6f-a049-4d77aa727ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.464817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af431-7431-4b6f-a049-4d77aa727ef2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.466589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 59/113] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:42.467415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896af431-7431-4b6f-a049-4d77aa727ef2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.513476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.575026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2cd8-041f-4e2d-bdfa-e7f9166fd933 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.617622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.618548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.618841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.619121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.630640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:42.631601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896af431-7431-4b6f-a049-4d77aa727ef2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-692be324-ef99-45ff-bb5c-8e0f5942b2dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:42.639523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:42.640418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:42.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 55/114] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:42.642365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.642454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.647067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.666230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:42.667486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:42.682495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.683494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.683809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.684083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.685393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.687110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.689066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 60/115] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.689658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.711217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.749470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 56/116] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:42.750421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.790679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.820373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931d1e-2ec1-4a19-a28b-2e9c0c4a88df None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.861139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.862154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.862532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.862901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.864732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.866477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.869349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 61/117] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.873955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.879938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff937b7-42df-4f6d-89b5-da5be625115a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.922004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.923980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.924565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.925039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.926432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:42.926971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.928584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.938391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 57/118] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.939551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.978804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.997491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dc3b-71d3-4594-ae8c-8b6bb89f97d1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.037931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.038824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.039109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.039388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.040899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.042991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.043566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.044977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 62/119] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.045563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.058864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e2827-e286-4e4e-9b24-f10243a4b54c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.095608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.096428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.096717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.096997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.107961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:43.117168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:43.118107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:43.118848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 58/120] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:43.120075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.170907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e347-5bcf-4f87-be5c-e72ef51ae701 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.207409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.208121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.208410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.208687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.209534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.211135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fff969-6faa-46e2-b2e3-30a95d507f1c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.232698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fd6e-90b2-4722-9445-405b9b5fe08e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.243623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 63/121] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:43.243623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578cb3-1a7d-4ac3-8915-b3053569a550 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.243623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578cb3-1a7d-4ac3-8915-b3053569a550 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.243623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578cb3-1a7d-4ac3-8915-b3053569a550 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.243623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 64/122] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:43.244155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578cb3-1a7d-4ac3-8915-b3053569a550 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.262930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.281503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.283750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.284368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.285051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] PATH_INFO: `/v3/users/3996e12863084ab0ad6ec16c7b68b9c0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.308956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] RBAC: Authorizing `identity:get_user(user_id=3996e12863084ab0ad6ec16c7b68b9c0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.310817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.314221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 59/123] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/users/3996e12863084ab0ad6ec16c7b68b9c0 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.315954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.332374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.370291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578cb3-1a7d-4ac3-8915-b3053569a550 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.412015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.413487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.413965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.414464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/650134ee12184024a2141ce2785d0e53/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.417378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, user_id=650134ee12184024a2141ce2785d0e53, role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.419698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380639a-d582-4871-b1b0-efca50d57915 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.431412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e0a5-a918-4c6e-8e25-afe00147272a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.441577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 65/124] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:43 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/650134ee12184024a2141ce2785d0e53/roles/a3f39bef9153404990abaf0bdd0608ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:43.443409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.444057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.444622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.465584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:43.467584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:43.472809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.473272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.473559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.473838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.474648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:43.474957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.476496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.498908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 60/125] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.499818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.545380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.555833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 66/126] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:43.557130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.601004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.638294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f45054-9888-4fc6-90dc-309d12c1b791 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.689885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.690559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.690844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.691120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.694116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf4db3-ae70-4679-8c32-b2d583d912b3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.751859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.753109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.753582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.754109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.755524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.757229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.759482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 67/127] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.760545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.780025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.782128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.861255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.896132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.917045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6a61-210d-4fde-8294-c4303c42b976 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.957308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.958971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.959452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.959945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.972129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:43.975603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 61/128] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:43.976777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:43.981461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:43.982761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:43.983517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:43.986158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 68/129] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:43.995570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.138078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404303-9c4f-489b-9b8e-9d3fb8e13973 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.199889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.200772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.201052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.201326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.204081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.205882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.207904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 62/130] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.214770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.253559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce970-0082-4d07-9594-5090f6a33b30 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.262368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.309595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.330928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ab38-1feb-4d89-9c1d-b072406c909b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.340952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.341842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.342129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.342407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.348292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.350160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.352478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 69/131] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.357563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.376404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.377909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.378403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.378853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.379885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:44.380378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.382431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.392466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 63/132] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.393553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.568302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26688e30-3019-441e-a3bd-ca3d207adaa3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.570636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.572414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66372e9-ce57-4f71-a6bc-b8c1229438fa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.626347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.627262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.627565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.627847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/801932a0f57f4075beaa7d9bf3b3839f/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.630458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, user_id=801932a0f57f4075beaa7d9bf3b3839f, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.631974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4dfcc-5c8e-4916-8dc4-3bfadd40c31b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.635323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.636018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.636303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.636581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.637434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=3996e12863084ab0ad6ec16c7b68b9c0) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:44.637802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.639503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.646686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 64/133] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/role_assignments?user.id=3996e12863084ab0ad6ec16c7b68b9c0&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=c468e25c98614299b7268cf2354f65ed => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.647623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.658705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 70/134] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:44 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/801932a0f57f4075beaa7d9bf3b3839f/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:44.738202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a7212-3401-49cd-9553-be7ca59afa70 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.739111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a7212-3401-49cd-9553-be7ca59afa70 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.739423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a7212-3401-49cd-9553-be7ca59afa70 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.741162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 71/135] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:44.748037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.748383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.748604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.767744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:44.769058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:44.803784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdbf5-683f-4e6f-9c23-6c33d46cfd92 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.856890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.858038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.858327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.858609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.860069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.861621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.864053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 65/136] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.870295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.908123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.945078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.948755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 72/137] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:44.988287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.036545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce8fe-b5ca-401c-842d-76740034dfdf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.073820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.074707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.075001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.075285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] PATH_INFO: `/v3/projects/6b0e0b9e53e54fbba6f881b67161799a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.076538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] RBAC: Authorizing `identity:get_project(project_id=6b0e0b9e53e54fbba6f881b67161799a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.078328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.080194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 66/138] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/projects/6b0e0b9e53e54fbba6f881b67161799a => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:45.085967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.177704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58abf-1467-473f-9753-c8b953ea168b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.230613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.231430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.231759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.232038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.242559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cddec-d743-4758-b348-da05324c7b0b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.243487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:45.251871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:45.252799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:45.253578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 73/139] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:45.259956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.260091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.312021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.318226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.318513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.318794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] PATH_INFO: `/v3/projects/6b0e0b9e53e54fbba6f881b67161799a/users/650134ee12184024a2141ce2785d0e53/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.321147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b0e0b9e53e54fbba6f881b67161799a, user_id=650134ee12184024a2141ce2785d0e53, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.325656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.328544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.356972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 67/140] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:45 2022] PUT /identity/v3/projects/6b0e0b9e53e54fbba6f881b67161799a/users/650134ee12184024a2141ce2785d0e53/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:45.413439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022591e7-26e6-4f0e-a325-994cc3ec9d08 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.457650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.458338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.458626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.458902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.459742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:45.460055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.461742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.471840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 74/141] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:45.478515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.622640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b3d0-bd7f-42d9-a35b-fe8cdc57d6a6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.659177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.660213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.660500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.660781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.662095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.663667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.666529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 68/142] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:45.672183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.785159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f92ef-f9a8-4488-9012-8b2e6a2ed0c3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.792271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.821802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.822465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.822752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.823027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.896499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.898065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.003279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 75/143] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:46.008899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.044130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.120450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3074d1-4a68-458c-803e-99b9d750a95e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.155466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.156382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.156667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.156946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.158286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.159848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af0dc4-c982-4ead-ba0c-e72b415ba6e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.161830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 69/144] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:46.167800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.171059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.275614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b933f9-3376-49c9-98bd-6829c7ae43bd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.310132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.310716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.310998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.311275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.312211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:46.312521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.314049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893385e1-e696-40e5-8c68-5b7c60656dff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.320598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 76/145] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:46.609792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c600d-4b5e-4f01-9fe6-0ed16e9ba562 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.610141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c600d-4b5e-4f01-9fe6-0ed16e9ba562 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.610325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c600d-4b5e-4f01-9fe6-0ed16e9ba562 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.611868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 70/146] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:46.617584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567b7a-5f5a-459d-ae42-d81767afe1d2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.618158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567b7a-5f5a-459d-ae42-d81767afe1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.618247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567b7a-5f5a-459d-ae42-d81767afe1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.636543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c5567b7a-5f5a-459d-ae42-d81767afe1d2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:46.637752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c5567b7a-5f5a-459d-ae42-d81767afe1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:46.706713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.712450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 77/147] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:46.749025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c600d-4b5e-4f01-9fe6-0ed16e9ba562 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.781981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbc13-05a2-4e61-90ad-783a3b3befbf None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.782293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbc13-05a2-4e61-90ad-783a3b3befbf None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.782538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbc13-05a2-4e61-90ad-783a3b3befbf None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.785847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 78/148] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:46.796199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.796486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.796763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.823244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:46.824479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:46.948005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 79/149] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:46.972899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.976966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.990964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c600d-4b5e-4f01-9fe6-0ed16e9ba562 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.056048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.056873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.057159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.057434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.059718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.061194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.062823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 71/150] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:47.072415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.162712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289f8bd-2d19-43b9-91cf-643821f0445e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.216456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:47.230671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.231911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.232412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.232873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.251136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:47.265190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea88e-87f5-4cc3-ad80-e9c0a3d968dc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:47.268936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:47.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:47.270558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:47.282491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 80/151] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:47.284739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.334929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.336924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.338235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.338866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.340187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.342758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.383715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 72/152] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:47 2022] POST /identity/v3/users => generated 283 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:47.454144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729af0-fef8-4305-8c06-da21c0d40695 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.502398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.503423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.503934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.504395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.505407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:47.505901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.507585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.521117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 81/153] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:23:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:47.527725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.563321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:47.675687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad061577-8f16-494a-ac2c-0a421d7fc125 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.718064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.719442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.720002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.720274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.721737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.723277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3ba39-0348-4a10-8af1-93b86c7cf689 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.726456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 73/154] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:47 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:47.731351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.789363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:47.851612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ad05-f109-4009-a378-a08ee7946977 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.892485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.893143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.893423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.893696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.972925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.974429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d920-110f-4fd7-8c34-f81a299a4750 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.983817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6f6d-164b-49f3-b9cf-298282384e09 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.984100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6f6d-164b-49f3-b9cf-298282384e09 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.984379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6f6d-164b-49f3-b9cf-298282384e09 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.985918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 74/155] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:47.991581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca621-5d15-4124-9136-fe97cc0519cb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.991982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca621-5d15-4124-9136-fe97cc0519cb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.992262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca621-5d15-4124-9136-fe97cc0519cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.013093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e37ca621-5d15-4124-9136-fe97cc0519cb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:48.014358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e37ca621-5d15-4124-9136-fe97cc0519cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.041556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.097207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 82/156] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:48.103466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c52-6390-41fb-ac48-fcaefee51473 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.103792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c52-6390-41fb-ac48-fcaefee51473 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.104076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c52-6390-41fb-ac48-fcaefee51473 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.105505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 83/157] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:48.106712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94c52-6390-41fb-ac48-fcaefee51473 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.121056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 75/158] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:48.123324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.124192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.124481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.145132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:48.146369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.164074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.243195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 76/159] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:48.244688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.259161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94c52-6390-41fb-ac48-fcaefee51473 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.300996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.301976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.302255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.302527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.303833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:48.305711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:48.307814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 84/160] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:48.308715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.330753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.361818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ca2c-4a2d-44f5-baa3-1f283f36ef11 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.403632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.404423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.404705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.404988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.417972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:48.428564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a05-6c18-4827-aa20-69431212f298 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:48.428982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:48.429872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:48.430728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:48.431987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 77/161] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:48.433648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.447949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.479091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.479955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.480241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.480529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.495135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d247bc54-7a3e-4638-a6f6-765b0c7b230a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:48.505285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:48.506185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:48.506985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 85/162] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:48.511002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fee9a-c65f-42d4-90fb-b12eace5a00e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.511002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fee9a-c65f-42d4-90fb-b12eace5a00e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.511002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fee9a-c65f-42d4-90fb-b12eace5a00e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.511002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 86/163] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:48.511950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fee9a-c65f-42d4-90fb-b12eace5a00e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.552837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa903e-9570-4374-b6df-33da87323669 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.588309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.588967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.589248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.589517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.590352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:48.590661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:48.592210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:48.599084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 78/164] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:48.600015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.627927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.656220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fee9a-c65f-42d4-90fb-b12eace5a00e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.684642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.702727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.703422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.703731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.704052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.704966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:48.705274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:48.707616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca00fb-5f16-4b92-9444-8207b4782956 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:48.720108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 87/165] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:48.721474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.721765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.722054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.723006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa71326-21f7-4083-8865-4d64c9cd34d2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.755353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:48.756796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.870658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.871098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 88/166] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:48.872094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.872679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.873178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.874143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:48.874691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:48.879567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.880737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:48.897438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 79/167] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:48.903343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.971989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.006847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1c22-a311-4d4e-bb4f-b39e37c70e51 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.047711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.048638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.048919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.049483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] PATH_INFO: `/v3/users/801932a0f57f4075beaa7d9bf3b3839f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.051133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] RBAC: Authorizing `identity:get_user(user_id=801932a0f57f4075beaa7d9bf3b3839f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.052675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.054359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 89/168] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/users/801932a0f57f4075beaa7d9bf3b3839f => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.055187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.165972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7879081-450b-4b89-a628-d7e29e5cd7e6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.170783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706074b-32b1-46cf-aa65-a0b9422145ee None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.207202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.208583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.209094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.209572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.217432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.217580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.218474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.218955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.219059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] PATH_INFO: `/v3/users/3996e12863084ab0ad6ec16c7b68b9c0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.224578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] RBAC: Authorizing `identity:get_user(user_id=3996e12863084ab0ad6ec16c7b68b9c0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.225063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:49.225778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.228233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 80/169] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/users/3996e12863084ab0ad6ec16c7b68b9c0 => generated 289 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.229147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:49.234245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:49.235139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:49.235939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:49.237434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.239935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 90/170] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:49.240974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.354698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cc51-6882-4472-a9e8-9c054d048ec2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.385147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c02d-af8e-406a-812e-93e5ac9a229f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.394234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.395456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.395987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.396469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.398097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.400200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.402521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 91/171] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.403706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.452259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.452929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.453210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.453478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.495965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.519997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fea06-8846-4cd0-a921-03e266fc7bc3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.547326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.548848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.551679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.601892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.602977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.603611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.604151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.605149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:49.605644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.607444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.627848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 92/172] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.632181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.649205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 81/173] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:49.656856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.759220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b0dc-06e9-428e-9d5d-e35ffceb69b5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.768624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943c5a-dae5-4539-94b2-0a751a63b63c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.771005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.795179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.799887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.801023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.801634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.802896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/3996e12863084ab0ad6ec16c7b68b9c0/roles/c468e25c98614299b7268cf2354f65ed` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.805386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, user_id=3996e12863084ab0ad6ec16c7b68b9c0, role_id=c468e25c98614299b7268cf2354f65ed)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.807192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.812373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.813209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.813580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.813798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] PATH_INFO: `/v3/users/650134ee12184024a2141ce2785d0e53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.815161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=650134ee12184024a2141ce2785d0e53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.819666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.819666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 82/174] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/users/650134ee12184024a2141ce2785d0e53 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.819666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.832750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 93/175] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:49 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/users/3996e12863084ab0ad6ec16c7b68b9c0/roles/c468e25c98614299b7268cf2354f65ed => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:49.834180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.928364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a593b-8717-4b4f-9cf9-0d2d11e9e0a2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.955935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a643aa-4c58-4b94-ba24-9be03083f5ed None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.972172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.973078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.973364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.973614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.974889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.976626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.978637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 83/176] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.985102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.996610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.997704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.998178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.998686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.030965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.067099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.084345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.086484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.096796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1ec0-d88d-4446-8bd9-85f215bda98f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.133858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.134529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.134813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.135085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.135971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=801932a0f57f4075beaa7d9bf3b3839f) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:50.136616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.137858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.144600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 84/177] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/role_assignments?user.id=801932a0f57f4075beaa7d9bf3b3839f&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:50.206497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 94/178] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:50.212693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.346643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbf44-36b2-40a3-b6fb-11c4d9de5249 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.349592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.386172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.387062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.387376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.387681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] PATH_INFO: `/v3/projects/6b0e0b9e53e54fbba6f881b67161799a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.388951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] RBAC: Authorizing `identity:get_project(project_id=6b0e0b9e53e54fbba6f881b67161799a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.390446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1027-4cba-48a7-aa9e-db232be35756 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.392626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 85/179] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/projects/6b0e0b9e53e54fbba6f881b67161799a => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:50.398345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.519179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.531958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f78f-2add-450a-adfe-1ef41ff55502 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.567264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.567964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.568244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.568518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.569362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=6b0e0b9e53e54fbba6f881b67161799a, user.id=650134ee12184024a2141ce2785d0e53) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:50.569668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.571632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9318dd-1b44-4c33-b80d-99a0bba4396f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.578207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 95/180] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/role_assignments?user.id=650134ee12184024a2141ce2785d0e53&scope.project.id=6b0e0b9e53e54fbba6f881b67161799a&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:51.125579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7554b-012c-4ceb-aade-6babcd5c2ecf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.125775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7554b-012c-4ceb-aade-6babcd5c2ecf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.126056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7554b-012c-4ceb-aade-6babcd5c2ecf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.127431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 86/181] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.133870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.133870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.134114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.152585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.153830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.209216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437f25e-31cf-4463-ac86-1ffb3f982f16 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.209532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437f25e-31cf-4463-ac86-1ffb3f982f16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.209764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437f25e-31cf-4463-ac86-1ffb3f982f16 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.211179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 87/182] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:51.216446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.217515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.218294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.231571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 96/183] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:51.237581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.239124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.249436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.323560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 88/184] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:51.337677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.340024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.363438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7caaf-0a92-4205-bf23-340315b65a2a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.401006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901169-b737-430d-95f2-b6af28af746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.402600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901169-b737-430d-95f2-b6af28af746d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.403069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901169-b737-430d-95f2-b6af28af746d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.403584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901169-b737-430d-95f2-b6af28af746d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.414711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901169-b737-430d-95f2-b6af28af746d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-28901169-b737-430d-95f2-b6af28af746d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:51.422671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:51.423551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:51.424335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:51.426663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 97/185] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:51.435633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901169-b737-430d-95f2-b6af28af746d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.472812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e3f6-fe19-466d-a394-205ad08c3777 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.495943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.522715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.523615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.523971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.524367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.540270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:51.541619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901169-b737-430d-95f2-b6af28af746d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c84ee30b-8e5c-4e8c-b952-ef08e9908b1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:51.549905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:51.550871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:51.552428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 89/186] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:51.553085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd9b0-75e7-4084-8889-57c922c8b293 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.553085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd9b0-75e7-4084-8889-57c922c8b293 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.553085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd9b0-75e7-4084-8889-57c922c8b293 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.554497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 90/187] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.559362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd9b0-75e7-4084-8889-57c922c8b293 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.584512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.585494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.585945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.586519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.587453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:51.587905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.589446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5fc3-6859-4a75-a59d-424fd482bc38 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.598340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 98/188] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:51.599731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.600171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.600577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.607777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.621003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.622171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.666935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd9b0-75e7-4084-8889-57c922c8b293 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.695730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 99/189] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:51.695730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.701321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.701991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.702269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.702536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.703290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:51.703631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.705014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.713683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 91/190] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:51.718906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.746675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.817935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb0485-a25c-4c63-9e91-74e3a287d5a3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.827696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce220781-14f9-4817-ae08-4ce944970112 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.854612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.855748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.856170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.856441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.859135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.862693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.864040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.864377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.864711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.873474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.874969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.876729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 100/191] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:51.879675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.881192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.882220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.883358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 92/192] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:51.888175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.970054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.988391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e48a5-652a-468f-b147-9a082d7efa9f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.990203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba91a78-360b-4100-ad9f-9499d542c4fa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.023150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.024104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.024521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.024797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.026166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.026688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.027398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.027676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.027806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.028152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.029585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 101/193] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.034876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.097771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.102183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.103777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.146069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fc57-687b-46ac-926d-c3c9f0b1131c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.182666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.183356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.183653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.183937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.185234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.209519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 93/194] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:52.209519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.258914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.260358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.315583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ce38-18c6-4522-9718-7325196e1b7f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.322943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.353034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.353753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.353989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.354259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.354985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.356522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.371846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 102/195] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:52.373101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.382704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 94/196] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:52 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:52.384073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.444001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.498566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5c09-6de2-454a-9a1a-bee09a2c78de None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.520292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079785-c0a4-444c-80c1-12bc0a301b45 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.540674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.541720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.541853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.542117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.543725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.545243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.551605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 103/197] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.554608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.569972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.571669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.571957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.572238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.573776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.575067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d1742-bbc1-4390-98a5-fb7b6b4f75ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.577048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 95/198] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.578183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160709b-ac44-4b23-97de-4fbdae46cc99 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.578414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160709b-ac44-4b23-97de-4fbdae46cc99 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.579769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160709b-ac44-4b23-97de-4fbdae46cc99 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.581070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 96/199] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:52.582675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160709b-ac44-4b23-97de-4fbdae46cc99 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.597000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.683576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31461-a250-4b9f-a7f4-4b975a782546 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.709718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160709b-ac44-4b23-97de-4fbdae46cc99 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.717993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.724679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.725356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.725637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.725913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.726813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=ba9e067c69f14701996c15f0b27de0f3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.727113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.729402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a70a98-9212-44fc-8b6f-ac9d9f8d8600 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.735987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 104/200] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/role_assignments?user.id=ba9e067c69f14701996c15f0b27de0f3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.737280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.737567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.738261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.749995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.750738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.751025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.752024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.753081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=ba9e067c69f14701996c15f0b27de0f3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.753532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.755064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.757881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:52.760264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:52.765204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 97/201] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/role_assignments?user.id=ba9e067c69f14701996c15f0b27de0f3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.850590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 105/202] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:52.876035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.034497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2ca3-e64a-4120-81a2-a2806525c1c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.069839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.070625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.071161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.071333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.082117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:53.090463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:53.091350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:53.092170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 98/203] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:53.098834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.132850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.212845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b0d9-6b05-4e0e-bd48-18eeb97331ac None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.248636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.249595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.250015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.250438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.251319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:53.251796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.253326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.262662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 106/204] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.268002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.320106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.427898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f4bf-e3c3-45d0-ab67-b6f552566c54 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.479184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.480107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.480388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.480662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] PATH_INFO: `/v3/users/3996e12863084ab0ad6ec16c7b68b9c0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.481895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] RBAC: Authorizing `identity:get_user(user_id=3996e12863084ab0ad6ec16c7b68b9c0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.483370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.485375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 99/205] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/users/3996e12863084ab0ad6ec16c7b68b9c0 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.491329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.619879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.637063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29617a-8e94-4f70-a7d0-071fc924fdf3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.680069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.681094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.681569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.682063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.767206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.769074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.853089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.877675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 107/206] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:53.888744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.020769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d3e1-9454-4353-a834-d04c7a8e8054 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.022692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.055991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.056868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.057150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.057424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.058635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.060135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51f337-6f89-4f60-aa32-938da50755ca None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.061853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 100/207] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:54.067737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.224464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20ee7-4f19-4956-8d89-441579a2062a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.292393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.293440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.293935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.294440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.295480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, scope.project.id=b8a83c85118e479982e2c6ad490b0b61, user.id=3996e12863084ab0ad6ec16c7b68b9c0) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:54.296007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.297681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2685-f0ce-4754-bd8c-dc8a5f97498a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.311875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 108/208] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/role_assignments?user.id=3996e12863084ab0ad6ec16c7b68b9c0&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=c468e25c98614299b7268cf2354f65ed => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.075357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d102-bd31-4d9b-b598-9410a733d2ce None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.075886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d102-bd31-4d9b-b598-9410a733d2ce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.075886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d102-bd31-4d9b-b598-9410a733d2ce None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.077245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 101/209] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:55.082712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.083121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.083286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.100760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:55.102017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:55.147689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.175648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 109/210] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:55.195605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d102-bd31-4d9b-b598-9410a733d2ce None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.306107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d102-bd31-4d9b-b598-9410a733d2ce None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.342511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.343233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.343512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.343808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.354506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9212341b-ad9f-495f-8f71-be0c80bfd94d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:55.362261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:55.363490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:55.364331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:55.367687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 102/211] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:55.370336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.398954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa5d2-bfa3-4ae4-9b61-2b651dc437fe None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.399285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa5d2-bfa3-4ae4-9b61-2b651dc437fe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.399499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa5d2-bfa3-4ae4-9b61-2b651dc437fe None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.401252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 103/212] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:55.406784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8d06-0c50-4130-bad1-7652acc047c7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.407306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8d06-0c50-4130-bad1-7652acc047c7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.407990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8d06-0c50-4130-bad1-7652acc047c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.426846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4f6e8d06-0c50-4130-bad1-7652acc047c7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:55.428389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f6e8d06-0c50-4130-bad1-7652acc047c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:55.451578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.480284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aede4-3af9-441b-a067-14346f4f0f9b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.503494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 104/213] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:55.504963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b899cf-52c1-4374-a11e-cf1744458370 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.505253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b899cf-52c1-4374-a11e-cf1744458370 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.505525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b899cf-52c1-4374-a11e-cf1744458370 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.506925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 105/214] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:55.508035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184aaf-a9eb-4064-a599-c990663f24f3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.508294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184aaf-a9eb-4064-a599-c990663f24f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.508567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184aaf-a9eb-4064-a599-c990663f24f3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.509782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 106/215] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:55.514940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.514940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.514940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.523616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.524306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.524587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.524857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.525614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:55.525916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.527321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c39c04-ca4c-4da9-9a0c-5fd02af1ea23 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.533277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:55.534458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:55.535958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 110/216] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.537170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.537455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.537730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.553534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:55.554826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:55.587676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.608159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 107/217] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:55.609243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.631801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 111/218] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:55.632926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.693779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.708589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae49b-c6a0-46ee-b127-b70aff356bed None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.730337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455984-9da1-4670-b797-c8dc1889dd41 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.741855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.742856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.743137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.743411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.744620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.746101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.747759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 108/219] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.748509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.764032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.764907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.765182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.765451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] PATH_INFO: `/v3/users/de049f05795f4884a88eaaf8f2d62e70` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.779198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] RBAC: Authorizing `identity:get_user(user_id=de049f05795f4884a88eaaf8f2d62e70)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.780777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.782688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 112/220] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/users/de049f05795f4884a88eaaf8f2d62e70 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.783289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.810718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.855260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2bd2-546b-4aca-810b-390153875f9c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.881174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae26d-deee-4e1b-a086-984f87919e19 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.890969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.891796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.892068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.892332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.902960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:55.913080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:55.914257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 109/221] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:55.915168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.918413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.919530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.919981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.920374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.933332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:55.933880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:55.941533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:55.942532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:23:55.943346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 113/222] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:55.944032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.023791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66182a5-50ee-4348-acd0-ed61a34654e2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.032089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.044790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad46b80-4daa-4ef5-8ecf-5aa5d739fb53 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.057434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.058134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.058442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.058720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.059441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.060939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.079333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.080018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.080319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.080596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.082048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 110/223] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:56.082857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.161496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.162971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.170279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.206578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16396-7b89-4767-8a9d-87e238911bf1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.245888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.246675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.247027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.247387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.248319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:56.248699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.250183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.260352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 111/224] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.266048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.269848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.290919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 114/225] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:56.292147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.383296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972ebfc-6dec-488e-b671-31ed93ba5cc7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.416306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1534a-8722-4bf5-9bad-c2b77d37baf3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.418995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.424912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.425632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.426294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.426294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.427080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:56.427387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.428950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.438575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 112/226] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.439197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.465704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.466594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.466872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.467138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.469318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.470794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.472469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 115/227] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.473238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.550950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.564586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cb211-e81a-4ba6-b101-2cca5f07232e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.603204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6097-3695-437f-8bd4-4fe98a44a495 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.611009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.613098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.613582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.614048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.616306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.618473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.621557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 113/228] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.626485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.646156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf514fb-9750-4849-af35-d300693821ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.647018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf514fb-9750-4849-af35-d300693821ba None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.647291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf514fb-9750-4849-af35-d300693821ba None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.647574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf514fb-9750-4849-af35-d300693821ba None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.648869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf514fb-9750-4849-af35-d300693821ba None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.650614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf514fb-9750-4849-af35-d300693821ba None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.652399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 116/229] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.655734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf514fb-9750-4849-af35-d300693821ba None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.705149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.748943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317665-2e38-4431-b341-0fe4e92ae659 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.780408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf514fb-9750-4849-af35-d300693821ba None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.795270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.796248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.796597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.796959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.798324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.800023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.801910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 114/230] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.802904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.811367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.826648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.827712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.828161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.829125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.830400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=de049f05795f4884a88eaaf8f2d62e70) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:56.830899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.833475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.841995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 117/231] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/role_assignments?user.id=de049f05795f4884a88eaaf8f2d62e70&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:56.843076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.943090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39047d5-b693-43be-abf1-c6f39fb33e3f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.983884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.986113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.986113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.986113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.987154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.988060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.992462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.994665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 115/232] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:57.000787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.109759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8d76-2544-4cd0-bb5a-8ebf72a48b1d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.119607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf572-90b4-4c66-bec0-6d92769e4ad0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.160318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.161294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.161641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.163114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/ba9e067c69f14701996c15f0b27de0f3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.168203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, user_id=ba9e067c69f14701996c15f0b27de0f3, role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.170388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd609c5-888a-40f5-ab3b-a6943f28f95f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.179017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.180869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.181365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.182002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/ba9e067c69f14701996c15f0b27de0f3/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.184386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, user_id=ba9e067c69f14701996c15f0b27de0f3, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.186299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad305b6-4612-4feb-aeeb-74cc8263e1d8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.192244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 116/233] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:56 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/ba9e067c69f14701996c15f0b27de0f3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:57.211314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 118/234] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:23:56 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/ba9e067c69f14701996c15f0b27de0f3/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:58.538211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae834-89a4-4292-a773-866d21fb7c87 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.539065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae834-89a4-4292-a773-866d21fb7c87 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.539065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae834-89a4-4292-a773-866d21fb7c87 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.540908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 117/235] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:58.549814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bad9-a70c-4683-92e6-c0afc7719221 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.550790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bad9-a70c-4683-92e6-c0afc7719221 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.551275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bad9-a70c-4683-92e6-c0afc7719221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.580593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3903bad9-a70c-4683-92e6-c0afc7719221 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:58.582127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3903bad9-a70c-4683-92e6-c0afc7719221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:58.651942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.688712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 119/236] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:58.737869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae834-89a4-4292-a773-866d21fb7c87 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.817207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5197-5ddd-4dbf-8808-fa8778656aff None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.817488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5197-5ddd-4dbf-8808-fa8778656aff None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.817762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5197-5ddd-4dbf-8808-fa8778656aff None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.819152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 120/237] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:58.826119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.826402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.826672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.845799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.864703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:58.866043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:58.919673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae834-89a4-4292-a773-866d21fb7c87 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.984303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.985135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.985418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.985691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.004437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 121/238] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:59.007290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:59.015140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:59.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:23:59.016806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 118/239] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:59.024790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.054961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.190899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19300d2-15b9-4817-b935-8e77dadc1cf6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.251945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.252684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6565-4913-46e8-bb24-51b7d0d643fe None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.263624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.284094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.284906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.285184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.285455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.287560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.289500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.292934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 119/240] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.297171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.317087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.317686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.317962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.318231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.318984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:59.319285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.320822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.337642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 122/241] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.344035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.468742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098ad7b-92f8-4bd6-83d3-c6ef9ed6d291 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.543731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.544533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.544775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.545047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.546860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.550660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95701a-e699-453f-bfa6-e82211a939cd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.552932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.581545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 120/242] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:23:59 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:59.610401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.611328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.611632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.611908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] PATH_INFO: `/v3/users/a7d0c43ac3d04dc0b03dea4a46228110` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.627518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] RBAC: Authorizing `identity:get_user(user_id=a7d0c43ac3d04dc0b03dea4a46228110)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.629067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52436-185c-46ef-9a9f-52e37cf656ca None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.631232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 123/243] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/users/a7d0c43ac3d04dc0b03dea4a46228110 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.637001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.689309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.754609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79bc-41bb-4023-8359-a6ce11843ecc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.799454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.801267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.801267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.801267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.854743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd29b-f6ac-4e31-bd67-12951dd0c496 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.855344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd29b-f6ac-4e31-bd67-12951dd0c496 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.855865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd29b-f6ac-4e31-bd67-12951dd0c496 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.857447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 124/244] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:59.863332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.863931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.864392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.879137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.881320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.885236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:59.886613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:59.912628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.923953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.968789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 125/245] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:59.988572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 121/246] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:59.994247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.996585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.097966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c8c0-6592-44e2-b591-3b9e9d7eb662 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.104249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd7dc-3c9f-468c-b172-3ae047cf50b2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.144240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.145425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.145709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.145978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.154237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.155749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.156226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.156704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.160950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:00.161199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.161672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ccfb8-5bff-44cf-ad39-8e34d344bd31 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.163709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 126/247] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.167634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9386f-86dc-4159-813e-1afbe53cbec9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.167634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9386f-86dc-4159-813e-1afbe53cbec9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.167634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9386f-86dc-4159-813e-1afbe53cbec9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.167634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 127/248] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9752eabe-dd9e-4d24-b20d-5367c892d5bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:00.167978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:00.168766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:00.169532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 122/249] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:00.172857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9386f-86dc-4159-813e-1afbe53cbec9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.177712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.178008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.178279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.185524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.198670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.198670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.212495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.281208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 123/250] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:00.288495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.303389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9386f-86dc-4159-813e-1afbe53cbec9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.342848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.343998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.344277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.344545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.345635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=a7d0c43ac3d04dc0b03dea4a46228110) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:00.345944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.348582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.355387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 128/251] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/role_assignments?user.id=a7d0c43ac3d04dc0b03dea4a46228110&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=c468e25c98614299b7268cf2354f65ed => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.356252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.445297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f97dcb-b50c-455a-b2c4-2cfb886a3e02 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.482394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.488694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.496285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.496602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a5a44-d865-4b9d-8be1-af557d9f9116 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.497025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.497311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.497588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.498646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:00.499599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.501098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5168-1f50-4912-8771-a57c37473cf1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.515571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 124/252] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.518620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110e251-2f50-4dc9-869b-9d4b373c8609 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.518914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110e251-2f50-4dc9-869b-9d4b373c8609 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.519212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110e251-2f50-4dc9-869b-9d4b373c8609 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.522174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 125/253] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:00.523295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110e251-2f50-4dc9-869b-9d4b373c8609 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.549590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.550441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.550722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.551249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.563643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4f27ffce-c1c2-497e-83dc-c19e2b8ab32d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:00.572012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:00.572946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:00.573731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:00.578147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 129/254] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:00.579564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.579861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.580138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.598690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.599988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.685591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110e251-2f50-4dc9-869b-9d4b373c8609 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.698562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 130/255] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:00.708082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.746221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.747175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.747677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.747956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] PATH_INFO: `/v3/users/de049f05795f4884a88eaaf8f2d62e70` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.749183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] RBAC: Authorizing `identity:get_user(user_id=de049f05795f4884a88eaaf8f2d62e70)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.750654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.752443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 126/256] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/users/de049f05795f4884a88eaaf8f2d62e70 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.753323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.837201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.858244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e438b8a-1215-4e99-b15f-01358565d4b5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.895674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.896352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.896628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.896897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.897769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:00.898013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.899425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.909837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 131/257] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.910667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.976060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.030901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016749-6178-46b6-b332-0f2e19bd0d4a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.070025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579353f-ff75-4de5-9b85-935860c479ff None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.078218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.079098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.079373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.079667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.080894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.082390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.084140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 132/258] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:01.085968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.106654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.139768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.140578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.140856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.141126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.176483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:01.189610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:01.190494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:01.191252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 127/259] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:01.195207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.234151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b09edc-c73b-408d-83bc-066abffa041d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.316806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.317724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.318001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.318272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.320788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.322312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.324283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 133/260] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:01.328723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.360265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323741a9-f742-40ed-9407-c718f6719c9a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.405691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.418840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.419778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.420066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.420349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/de049f05795f4884a88eaaf8f2d62e70/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.422985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, user_id=de049f05795f4884a88eaaf8f2d62e70, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.424707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.448562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 128/261] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:01 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/de049f05795f4884a88eaaf8f2d62e70/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:01.452508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.515505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.579004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17c0-0a17-486b-b35a-aae40b171b0a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.664639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae472-0907-4bbc-b201-e8e723a16690 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.668769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.669692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.670175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.670651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.671614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.672105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.673689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.691769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 134/262] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:01.697150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.708272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.709009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.709284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.710816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.801475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.829730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.831721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.958725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb43ed4-982e-4300-b167-2ebdf87566b2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.020256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 129/263] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:02.032616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.045049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.046164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.046283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.046526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] PATH_INFO: `/v3/users/ba9e067c69f14701996c15f0b27de0f3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.052397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] RBAC: Authorizing `identity:get_user(user_id=ba9e067c69f14701996c15f0b27de0f3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.054070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.056562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 135/264] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/users/ba9e067c69f14701996c15f0b27de0f3 => generated 283 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.062153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.088097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.191175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.250076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad3d6f-08e4-4430-a678-024103f62926 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.312667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971fce-e163-4ed1-a6c6-f52f9ed0092e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.323049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.323966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.324243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.324522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.325717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.327185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.329250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 130/265] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:02.338730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.374999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.376088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.376608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.377095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.460618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.462623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.496740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.659435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 136/266] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:02.665839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.671398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8962963-4cd8-4431-bea5-19d70bbda5a5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.745188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.745847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.746116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.746392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.747268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=ba9e067c69f14701996c15f0b27de0f3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:02.747553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.749003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd855-dbbf-439a-8c22-53ec43736946 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.765709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 131/267] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/role_assignments?user.id=ba9e067c69f14701996c15f0b27de0f3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 608 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.767035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fbc3-586d-4e4f-891b-bc6e3e26160f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.767317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fbc3-586d-4e4f-891b-bc6e3e26160f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.767608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fbc3-586d-4e4f-891b-bc6e3e26160f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.769053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 132/268] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:02.774735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.774967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.775242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.827605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:02.827605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:02.831488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589471e-edf9-41dd-8b0e-92349154e749 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.842690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.854534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.899163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.901021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.901507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.902073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.908835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.911143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.913961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 137/269] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.922405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.030154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 133/270] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:03.065336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.088843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de311af-29d5-416c-8f0d-4ef488d3edb5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.133052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.134321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.135056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.135583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.136658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=ba9e067c69f14701996c15f0b27de0f3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:03.137154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.138814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae168-dfce-40c1-afa4-24a439a16d6c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.149318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 138/271] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/role_assignments?user.id=ba9e067c69f14701996c15f0b27de0f3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:03.212260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f50b5-60b3-41bc-9fd2-c1613cd3ab76 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.212629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f50b5-60b3-41bc-9fd2-c1613cd3ab76 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.212838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f50b5-60b3-41bc-9fd2-c1613cd3ab76 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.214297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 139/272] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:03.220405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.220769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.220965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.240904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:03.242216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.262530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe84eda-0fca-4784-bbce-5a8e159d30fc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.280426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.323872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 140/273] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:03.349233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.357113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.357927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.358207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.358477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.392631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:03.404688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:03.405656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:03.406416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 134/274] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:03.412583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.430819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.462977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43277b-66b9-41cd-8bc8-2fa96c297999 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.507461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.508838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.509123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.509400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.510599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.512566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b556a-9571-4a7e-83f6-bd914a960e3a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.514777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 141/275] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:03.516844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9132e-db83-4e03-85fa-8ecf30887598 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.517130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9132e-db83-4e03-85fa-8ecf30887598 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.517399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9132e-db83-4e03-85fa-8ecf30887598 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.518747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 142/276] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:03.521230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9132e-db83-4e03-85fa-8ecf30887598 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.572405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.581198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d44b5-887c-4a85-b33b-9b920df4b6b7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.622154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.622830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.623111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.623387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.624182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:03.624487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.625880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b4d3-5406-4e5a-8b8e-6e7ca11abb28 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.635340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 135/277] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:03.640919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.641214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.641499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.651447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9132e-db83-4e03-85fa-8ecf30887598 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.658305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:03.659469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.688732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.689421 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.689651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.689936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.690642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.692151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.719649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 143/278] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:03 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:03.726331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.728766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.735438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 136/279] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:03.766615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.863594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.873976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea63a8-03cd-493d-858b-746db79b3ee8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.923955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819009e-81dc-4cdc-a168-9e7367849eab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.929233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.930336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.930613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.930874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] PATH_INFO: `/v3/users/6a908ef1f2b2488e926f725f84d5b9a8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.949011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] RBAC: Authorizing `identity:get_user(user_id=6a908ef1f2b2488e926f725f84d5b9a8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.950868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.952935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 144/280] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/users/6a908ef1f2b2488e926f725f84d5b9a8 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:03.960566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.972090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.972843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.973122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.973392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.988120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:03.996350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:03.997287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:03.998062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:04.000033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 137/281] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:04.007106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.081055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.083572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d59b-25f1-43e7-8283-cd8bb0dbbfaf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.134127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.134918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.135259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.135672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.136599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, user.id=6a908ef1f2b2488e926f725f84d5b9a8, scope.system=all) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:04.136913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.138424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.146600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 145/282] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/role_assignments?user.id=6a908ef1f2b2488e926f725f84d5b9a8&scope.system=all&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:04.151744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e44b3-417a-4e47-8f54-0ca410fc9710 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.208434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.209249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.209537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.209812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.211612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:04.211941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.213424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278dafb-e559-47e4-bc80-ee9c27f19abc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.229487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 138/283] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:04.234817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.275095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.354903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3120f3-4c6c-4f47-81da-0a09ec5a62b1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.355226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3120f3-4c6c-4f47-81da-0a09ec5a62b1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.355454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3120f3-4c6c-4f47-81da-0a09ec5a62b1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.357167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 139/284] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:04.364086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.364363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.364643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.384159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:04.385630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:04.394810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e2ed4-33b5-4f79-90be-af25d4a399d5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.451559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.451559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.451559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.451559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] PATH_INFO: `/v3/users/a7d0c43ac3d04dc0b03dea4a46228110` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.463752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] RBAC: Authorizing `identity:get_user(user_id=a7d0c43ac3d04dc0b03dea4a46228110)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.463752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.463752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 146/285] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:04 2022] GET /identity/v3/users/a7d0c43ac3d04dc0b03dea4a46228110 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:04.463752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.496558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 140/286] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:04.523874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.591108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.648509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.648924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e9ef-d790-4816-9b13-f672ec2e191c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.688850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019bd7-841d-4ce2-ac4f-230222d0726b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.691411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.692247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.692526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.692800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.714317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:04.728263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:04.729190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:04.730423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 141/287] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:04.735978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.778392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.779201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.779479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.779784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.781279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.789308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.791548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 147/288] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:04 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:04.796904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.941099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8760-8e59-4b6d-a75f-08566c5b6c74 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.961794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.978468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566311d8-b7b6-4e34-b2a1-7b66766b8d2f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.008989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.009720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.010004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.010276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.011029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:05.011334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.012747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.025328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 142/289] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:05.030813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.042535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.043493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.043856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.044135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/a7d0c43ac3d04dc0b03dea4a46228110/roles/c468e25c98614299b7268cf2354f65ed` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.047069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, user_id=a7d0c43ac3d04dc0b03dea4a46228110, role_id=c468e25c98614299b7268cf2354f65ed)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.048569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.076265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 148/290] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:04 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/users/a7d0c43ac3d04dc0b03dea4a46228110/roles/c468e25c98614299b7268cf2354f65ed => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:05.157257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bdd4-0618-4e59-8454-954173f958fd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.200962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.201850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.202176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.202451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] PATH_INFO: `/v3/users/de049f05795f4884a88eaaf8f2d62e70` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.203799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] RBAC: Authorizing `identity:get_user(user_id=de049f05795f4884a88eaaf8f2d62e70)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.205287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.207090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 143/291] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/users/de049f05795f4884a88eaaf8f2d62e70 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:05.213220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.247561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.371327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c400-6fe6-4626-8e99-8241dffd62ec None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.410839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.411501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.411846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.412134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.484835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.486317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.510178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.628252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 149/292] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:05.633553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.704306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.799173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67c62-97d4-4f8e-83fb-c6001c7e4a44 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.847415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.848688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.849202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.849680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.853298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.855020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbeb7b-a900-4cf3-bbee-8fc76efca799 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.857016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 144/293] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:05.863354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.037148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e5de-0fe3-421f-8dcd-ec3ecda45507 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.059612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.088757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.089827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.090322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.090795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.091864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=de049f05795f4884a88eaaf8f2d62e70) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:06.092372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.094032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82383-5a2d-43d2-96e6-9e46508f4420 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.104300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 150/294] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/role_assignments?user.id=de049f05795f4884a88eaaf8f2d62e70&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:06.576143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab35b19-776e-4e3f-a550-46c38e276534 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.577191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab35b19-776e-4e3f-a550-46c38e276534 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab35b19-776e-4e3f-a550-46c38e276534 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.581946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 145/295] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.586461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.587000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.587493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.605399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.606945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.642509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1604-a517-4b84-845d-cd9ed4d96a9c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.642821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1604-a517-4b84-845d-cd9ed4d96a9c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.643072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1604-a517-4b84-845d-cd9ed4d96a9c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.644770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 146/296] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:06.651821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.651821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.652072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.675509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.677741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.680608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 151/297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.705789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.759692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 147/298] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:06.780456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.826803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.837180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8f03a-8bab-48db-84b1-939d5f35935d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.846827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.878289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.879952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.880432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.880897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.882574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.884297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.886178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 152/299] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:06.891936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.909342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21d9b-eb1f-4cee-8445-d7871378fe87 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.950856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.951792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.952076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.952355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.963216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bcd1571c-18ee-49e2-964b-23870c558d8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:06.970886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:06.971967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:06.972794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 148/300] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:06.973440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a3e-e471-41fd-ad3b-c5d7978b4f81 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.973687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a3e-e471-41fd-ad3b-c5d7978b4f81 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.973963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a3e-e471-41fd-ad3b-c5d7978b4f81 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.979461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 149/301] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.979461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025a3e-e471-41fd-ad3b-c5d7978b4f81 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.000972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded166-fc30-49c1-81d6-4fcb220be311 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.036049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.036796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.037014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.037269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] PATH_INFO: `/v3/groups` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.038016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.039619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753755f-260b-4246-a566-1e685caf9e20 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.055067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 153/302] 10.222.0.75 () {60 vars in 1134 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:07.066139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.067472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.067992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.083069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.091233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025a3e-e471-41fd-ad3b-c5d7978b4f81 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.097913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:07.099592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:07.131971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.132494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.132775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.133045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.133869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.134176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.135669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.145215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.150969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 150/303] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:07.152429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.210782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 154/304] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:07.240571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.270771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0cb1-ed85-465e-9e60-67e3337781ef None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.318973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.320037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.320321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.320589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] PATH_INFO: `/v3/users/09d61bc6a7234f40a703925ab61066fb` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.337946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] RBAC: Authorizing `identity:get_user(user_id=09d61bc6a7234f40a703925ab61066fb)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.339336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.345941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 151/305] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/users/09d61bc6a7234f40a703925ab61066fb => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:07.347207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.367226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.369955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe3c4-3f51-4df6-aaf9-a8b18871c081 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.418328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.420008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.420662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.421089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.435402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:07.446059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:07.447203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:07.448217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:07.450878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 155/306] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:07.456641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.460950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354992-d722-47c9-a8b8-abf6a49ad697 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.490463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.507062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.508005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.508289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.508566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.509445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, user.id=09d61bc6a7234f40a703925ab61066fb, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.509758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.511335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.523739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 152/307] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/role_assignments?user.id=09d61bc6a7234f40a703925ab61066fb&scope.system=all&role.id=c468e25c98614299b7268cf2354f65ed => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.588850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f98dd-c34e-448e-9362-ac1610564295 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.634058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.635159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.635655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.636124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.637074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.637578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.639219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab68952-e384-41e7-9b9c-1a9e0b13643a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.649254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 156/308] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:07.655360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.712231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ed35-523c-4402-a83d-5f6a5fae32e4 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.713066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ed35-523c-4402-a83d-5f6a5fae32e4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.713579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ed35-523c-4402-a83d-5f6a5fae32e4 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.715716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 157/309] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:07.722105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.722380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.722647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.744821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:07.746008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:07.755984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.776906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2f62-7600-452f-b9f7-1cb772d3a825 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.824455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.825722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.826053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.826355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] PATH_INFO: `/v3/users/6a908ef1f2b2488e926f725f84d5b9a8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.827840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a908ef1f2b2488e926f725f84d5b9a8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.829581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.831024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 158/310] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:07.835667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 153/311] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/users/6a908ef1f2b2488e926f725f84d5b9a8 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.844219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.855417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.866474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.958757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe8be0-c130-4c98-9994-5ddc6099641a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.978133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb38abd-898d-4d94-8983-0284203fafb5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.995760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.996970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.997436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.997922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] PATH_INFO: `/v3/system/users/6a908ef1f2b2488e926f725f84d5b9a8/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.999732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a908ef1f2b2488e926f725f84d5b9a8, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.001335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.019348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 159/312] 10.222.0.75 () {58 vars in 1334 bytes} [Thu May 26 12:24:07 2022] PUT /identity/v3/system/users/6a908ef1f2b2488e926f725f84d5b9a8/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:08.021693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.022657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.023022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.023255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.036526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:08.044691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:08.045634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:08.046417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 154/313] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:08.052477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.148029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.168163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b076c-5036-4a84-9fb2-3b9346cd44f9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.207022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.207726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.208005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.208276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.209033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:08.209334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.211216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.220919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 160/314] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:08.226816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.240619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.338319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b68d57-0a2c-4473-8c4d-215dfd979f2a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.373860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.375097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.375606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.376065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] PATH_INFO: `/v3/users/a7d0c43ac3d04dc0b03dea4a46228110` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.377443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] RBAC: Authorizing `identity:get_user(user_id=a7d0c43ac3d04dc0b03dea4a46228110)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.379109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.381262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 155/315] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/users/a7d0c43ac3d04dc0b03dea4a46228110 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:08.387166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.491548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58527-573e-42ff-ab65-d10ac0d2221f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.526369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.527020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.527295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.527620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.547146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.598025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.599526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.700931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 161/316] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:08.706598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.791560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.812067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa284-c576-4907-9b75-097c7e7be40f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.845305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.846176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.846450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.846720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.847915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.849355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32734-82ab-4518-90ec-d49ecc7a9ee2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.851511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 156/317] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:08.857371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.901730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.958855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e699-bce5-4d2a-b216-6de7701acdf5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.996855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.997508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.997781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.998051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.998884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7, user.id=a7d0c43ac3d04dc0b03dea4a46228110) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:08.999188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.000670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636c5ac-bb8c-4336-a3b6-3fc92772bc01 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.006629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 162/318] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/role_assignments?user.id=a7d0c43ac3d04dc0b03dea4a46228110&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=c468e25c98614299b7268cf2354f65ed => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:09.403468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86179b47-6854-4f07-b5f5-dd0181542d5b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.403916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86179b47-6854-4f07-b5f5-dd0181542d5b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.404035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86179b47-6854-4f07-b5f5-dd0181542d5b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.405572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 157/319] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:09.410633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.410917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.411189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.428366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:09.429485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:09.499366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 163/320] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:09.521717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86179b47-6854-4f07-b5f5-dd0181542d5b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.630990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86179b47-6854-4f07-b5f5-dd0181542d5b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.667174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.667910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.668183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.668450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.669880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.671331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ec41-ad8f-4c4f-9383-131937c74f90 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.673154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 158/321] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:09.678989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.728828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.733943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d54a7-8fde-4ad7-865c-7c6a24bae1b7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.734408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d54a7-8fde-4ad7-865c-7c6a24bae1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.734517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d54a7-8fde-4ad7-865c-7c6a24bae1b7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.736188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 159/322] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:09.742134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.742391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.742687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.759642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:09.760825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:09.769754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.814138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfb85a-0fea-4b03-9bdd-41c2e6cddbb8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.840114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 160/323] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:09.847581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.848253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.848537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.848808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.849492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.851057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.865012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.866858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 164/324] 10.222.0.75 () {60 vars in 1134 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/groups => generated 226 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:09.975313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab38f-358f-403e-845d-942c13c53be8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.012319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.013136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.013411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.013679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.025898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:10.039198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.040206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:10.040983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:10.041573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 161/325] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:10.049992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.165662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.172662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd927-01ba-4cb7-9560-f3ea328e44a7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.215102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.215811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.216090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.216358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.217118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.217443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.218835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0839-d421-49ab-9b1e-de58aceae6ee None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.229266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 165/326] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.234910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.238463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.318979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bb1dc-609b-47d2-9bba-4e39e4d93150 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.319221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bb1dc-609b-47d2-9bba-4e39e4d93150 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.319527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bb1dc-609b-47d2-9bba-4e39e4d93150 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.321553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 166/327] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:10.328037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.328317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.328588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.348606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022dd6-dd0a-4b19-b659-250a1a27de56 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.351447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:10.352644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:10.395288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.396215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.397148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.397322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] PATH_INFO: `/v3/users/09d61bc6a7234f40a703925ab61066fb` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.399438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] RBAC: Authorizing `identity:get_user(user_id=09d61bc6a7234f40a703925ab61066fb)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.402435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.404349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 162/328] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/users/09d61bc6a7234f40a703925ab61066fb => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.411217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.455143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 167/329] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:10.481626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.494805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.533216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd908ba-588a-420f-9027-874ee0fc256e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.574315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.575359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.575695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.575974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] PATH_INFO: `/v3/system/users/09d61bc6a7234f40a703925ab61066fb/roles/c468e25c98614299b7268cf2354f65ed` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.578256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=09d61bc6a7234f40a703925ab61066fb, role_id=c468e25c98614299b7268cf2354f65ed)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.580615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.595425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 163/330] 10.222.0.75 () {58 vars in 1334 bytes} [Thu May 26 12:24:10 2022] PUT /identity/v3/system/users/09d61bc6a7234f40a703925ab61066fb/roles/c468e25c98614299b7268cf2354f65ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:10.604354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.624834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaff3-c3fb-4bd0-bb81-f48eb5bd1af1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.665763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.666593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.667076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.667527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.681538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:10.689758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.690714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:10.691509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:10.692155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 168/331] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:10.698994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.816217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e44e9-72cb-4157-b071-b29034c0a4dd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.853359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.854075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.854355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.854627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.855385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.855714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.857105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.859846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.867784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 164/332] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:10.873653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.983316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37fff-cb8d-4292-ace1-6586face1e7e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.027572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.028453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.028729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.029001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] PATH_INFO: `/v3/users/6a908ef1f2b2488e926f725f84d5b9a8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.031021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] RBAC: Authorizing `identity:get_user(user_id=6a908ef1f2b2488e926f725f84d5b9a8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.032579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3eeb7-bf20-4a8d-bce7-1c17b7e70c80 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.034613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 169/333] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/users/6a908ef1f2b2488e926f725f84d5b9a8 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:11.040379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.164805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70f29f-1918-4699-8b66-c6815bfe5f3e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.202498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.203168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.203448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.203788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.204639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] RBAC: Adding query filter params (role.id=68642b462a1f4c3e9599fabc3387b853, user.id=6a908ef1f2b2488e926f725f84d5b9a8, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:11.204960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.206465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74710753-82d1-488f-92da-a8190c3e0638 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.220956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 165/334] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/role_assignments?user.id=6a908ef1f2b2488e926f725f84d5b9a8&scope.system=all&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.448398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5cb8a-e2da-41f3-80b5-21ba016c6a82 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.449453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5cb8a-e2da-41f3-80b5-21ba016c6a82 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.449941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5cb8a-e2da-41f3-80b5-21ba016c6a82 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.451843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 170/335] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:12.456841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.457638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.458125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.480666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:12.482253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:12.543968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.568833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 166/336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:12.599969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5cb8a-e2da-41f3-80b5-21ba016c6a82 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.621097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.719765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5cb8a-e2da-41f3-80b5-21ba016c6a82 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.765320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.766198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.766481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.766752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.800433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:12.808760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.809645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:12.810416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:12.812525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 171/337] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.817418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.946933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1aeb-3db7-4b72-840e-50bf98dcdaf2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.002090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.002705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.002984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.003260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.004057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.004370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.005872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.015476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 167/338] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.020927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.118985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.142173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920caf-e3aa-4893-baca-8fa9b1fc1402 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.187245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.187935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.188216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.188489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.271672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.273347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.368438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.396664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 172/339] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:13.402202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.456046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.524138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efbdd3-f024-4227-8a37-b2a7c07033ba None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.567965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.568928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.569213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.569492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.570708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.572300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd3cd-ffd0-4f3d-8cfd-96fcfb2ba55b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.574371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 168/340] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.579777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.707177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d0f5-2f50-42c1-8d79-64134dd62e64 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.739484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700047-5a9c-4e3e-834f-b070ba245b75 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.739835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700047-5a9c-4e3e-834f-b070ba245b75 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.740058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700047-5a9c-4e3e-834f-b070ba245b75 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.741645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 169/341] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:13.746833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f80-7d87-4ccd-907e-ec7ec90cb53d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.747126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f80-7d87-4ccd-907e-ec7ec90cb53d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.747406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f80-7d87-4ccd-907e-ec7ec90cb53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.754587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.755466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.755771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.756109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.765850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.767404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.770449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 173/342] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.776355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.803569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d7922f80-7d87-4ccd-907e-ec7ec90cb53d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:13.803569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d7922f80-7d87-4ccd-907e-ec7ec90cb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:13.830146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.947957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 170/343] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:13.950062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74188-1931-49e7-8b4a-dc9d69f6bab8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.950587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74188-1931-49e7-8b4a-dc9d69f6bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74188-1931-49e7-8b4a-dc9d69f6bab8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.952113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53157523-3487-42d7-b062-e9ba9025ed49 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.952842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 171/344] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:13.954079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d93-7c0e-4e70-9478-1f580835732e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.954696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d93-7c0e-4e70-9478-1f580835732e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.955155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d93-7c0e-4e70-9478-1f580835732e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.957480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 172/345] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:13.963208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.963711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.964114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.993534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.994569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.994999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.995152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:13.995409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.996407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=b8a83c85118e479982e2c6ad490b0b61) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.996546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:13.996979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.000808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6ae50-1c73-4a18-a68f-b605d34a63c9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.007344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 174/346] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:14.009160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.009650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.010093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.028778 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:14.030459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:14.042613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.080642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 173/347] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:14.087802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.128857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 175/348] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:14.129987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.195998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.306948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cea463-c33a-4896-a354-5a46bc8244f5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.326470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f4b64-fe2a-43c4-a5e1-b37b31df73ec None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.357053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.358475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.359095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.359885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.368907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.370134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.370625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.371031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.373828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:14.383103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:14.383504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.384382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:14.385198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 176/349] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.385903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:14.399388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.400546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:14.401539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:14.404080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 174/350] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.405067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.472824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.546858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.555489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6da2-ba78-4122-846d-5e5fff07eda0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.590427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd40e14-48c5-4086-90b0-c8b0ec3f69ab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.600409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.603805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.604082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.604342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.620305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:14.628408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:14.630103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 177/351] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.630806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.641395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.642824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.643327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.643837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.644794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.645301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.648044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39fe0-9949-4db2-9e01-3dbc367531eb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.660453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 175/352] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.662443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6abb-8f2d-42ee-976a-bd218beb6e64 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.662981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6abb-8f2d-42ee-976a-bd218beb6e64 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.663505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6abb-8f2d-42ee-976a-bd218beb6e64 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.669831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 176/353] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:14.670457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff6abb-8f2d-42ee-976a-bd218beb6e64 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.767712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877116b-b8f0-4655-8073-6cbf3edf3f6b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.804284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.816071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff6abb-8f2d-42ee-976a-bd218beb6e64 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.819735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.820693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.821143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.821632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.822559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.823053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.824783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.834844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 178/354] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.836083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.858157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.858157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.858425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.858663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.859334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.859680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.861955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1046-38a2-4ef7-ac82-fc50169988ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.865152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.874432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 177/355] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.876022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.876310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.876587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.899930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:14.901435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:14.970573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd070e-2939-4458-ba00-fd021a07dc4e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.996563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 178/356] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:14.997415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.024270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.025563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.026065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.026520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] PATH_INFO: `/v3/users/09d61bc6a7234f40a703925ab61066fb` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.028409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] RBAC: Authorizing `identity:get_user(user_id=09d61bc6a7234f40a703925ab61066fb)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.030659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.033414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 179/357] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/users/09d61bc6a7234f40a703925ab61066fb => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.034622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.134942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.149889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147870de-f896-474e-9eff-9666d62a49a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.150607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.171833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13307-4f93-477e-a462-fa91b7625786 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.190276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.191201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.191661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.192088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.216331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.217135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.217508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.217869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.282758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.284260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.311226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.313139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.397498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.417089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.421231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 179/358] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:15.422540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.441547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 180/359] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:15.443259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.556904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b9dd2-1262-4cf7-af12-c80164abc6a5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.566354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c832-590e-4997-bd20-e047713ae950 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.603622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.605012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.605526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.605952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.607053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] RBAC: Adding query filter params (role.id=c468e25c98614299b7268cf2354f65ed, user.id=09d61bc6a7234f40a703925ab61066fb, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:15.607732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.609538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.611610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.613085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.613643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.614032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.625912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 180/360] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/role_assignments?user.id=09d61bc6a7234f40a703925ab61066fb&scope.system=all&role.id=c468e25c98614299b7268cf2354f65ed => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.626751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:15.627292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:15.635593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:15.636635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:15.637493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 181/361] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:15.638192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.700349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.701374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.770249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449de8-58ea-4bad-a455-7a0aba4f2177 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.775848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4f69-5c0d-4aac-9119-3002315b887f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.809663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51795045-9080-4649-a670-cdf663ed850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.810829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795045-9080-4649-a670-cdf663ed850b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.811166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795045-9080-4649-a670-cdf663ed850b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.811378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795045-9080-4649-a670-cdf663ed850b None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.812732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51795045-9080-4649-a670-cdf663ed850b None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.812849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.813635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.813915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.814183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.814286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51795045-9080-4649-a670-cdf663ed850b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.815437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.816979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1fcea-8a67-4187-a071-0688e1e8ddb2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.818962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 181/363] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.819206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 182/363] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.820256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51795045-9080-4649-a670-cdf663ed850b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.822281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e23b-7e92-41d6-804b-bb46c0ff792c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.822567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e23b-7e92-41d6-804b-bb46c0ff792c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.822845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e23b-7e92-41d6-804b-bb46c0ff792c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.824430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 182/364] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:15.825135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338e23b-7e92-41d6-804b-bb46c0ff792c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.940973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51795045-9080-4649-a670-cdf663ed850b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.943857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338e23b-7e92-41d6-804b-bb46c0ff792c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.957048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.972113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.985222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.986631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.986906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.987171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.988915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:15.989222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.990332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.991022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.991197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.991475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.991774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.993099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.994925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3742e-f0c6-444f-b173-257b9c106078 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.997126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 183/365] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.998271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.998583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.998821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.002213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 183/366] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.004028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.017093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.018262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:16.109277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 184/367] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:16.110513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.121499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6a3b-ebe9-4afa-a214-e6e174df29f0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.169917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.171112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.171569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.171847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.173064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.174526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.176221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 184/368] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.177272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.236917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37822a2-07da-40c7-ad8d-6269482cc5fc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.238755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.259944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.282746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.283420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.284047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.284325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.285469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.285780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.287975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.296504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 185/369] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.297914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.313225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d295c6-8b9b-4df4-b79d-aed263889392 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.356485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.357152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.357432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.357703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.444342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c8ff-24e7-48de-aa89-d1379c7d4048 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.450305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.452007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.494638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.496118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.496596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.497099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.509143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.516452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:16.527630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.528588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:16.529364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 186/370] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.530727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.581818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.606813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 185/371] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:16.608219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.672203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5583-dc44-47d8-91aa-22af82bc1b3d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.712546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.713828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.714321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.714798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.716448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=b8a83c85118e479982e2c6ad490b0b61) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.716773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.718375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.725302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d81d1c-f441-4575-ab1a-5a0803cc86b7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.726250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 187/372] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.727325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.782777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.783401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.783745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.784284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.785072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.785374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.787352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270cbe8-9df9-4a75-847d-1b7ac6dfd78e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.800908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 186/373] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.802899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704555-85dd-468a-9579-47ffac246641 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.803196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704555-85dd-468a-9579-47ffac246641 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.803713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704555-85dd-468a-9579-47ffac246641 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.805525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 187/374] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:16.806288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a704555-85dd-468a-9579-47ffac246641 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.827949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.886569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.890216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e470-ee54-47f0-ad1e-eca85b9e97e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.937712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.938780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.939056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.939701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.940969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.942573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06939-f818-4744-8b51-f99bb21825a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.945541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 188/375] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.946839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.947124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.947395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.971072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a704555-85dd-468a-9579-47ffac246641 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.972457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.973678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:17.040153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.040604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.041081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.041489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.067105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 189/376] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.068463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.150240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.152302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.158916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.189020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.195201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f239f0-32ad-4acc-a8bb-2b1d7ccbe95d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.240907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.241778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.242048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.242312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.243497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.244967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.246911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 190/377] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.247730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.283471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 188/378] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:17.284215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.364730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bced1f-0887-4085-9ae4-c9e830894e0a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.398183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f200-bbaf-46d9-b623-5501fa520943 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.400220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.400983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.401843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.402257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.402672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.414829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:17.422874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.423828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.424673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:17.425270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 191/379] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.425961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.440844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.441939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.442435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.442921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.444432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.444918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.446807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.454877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.455145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 189/380] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.456725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.549978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440a32-1c48-4921-8c5d-6e8f3c5ffe2b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.619046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.619880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.621011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.621292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] PATH_INFO: `/v3/projects/f7b62d8bc2904e559160e9d978cde596` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.622736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] RBAC: Authorizing `identity:get_project(project_id=f7b62d8bc2904e559160e9d978cde596)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.624244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.626289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 192/381] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/projects/f7b62d8bc2904e559160e9d978cde596 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.631745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.644946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393786d-c851-4bd6-933f-be0d950fec30 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.714591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.715278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.715566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.715869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.716602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.716902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.718329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.732517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 190/382] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.739376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.801692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.808683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711ebd-6f0a-4304-9365-a5ce2a467076 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.824173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.864160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.866785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.867060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.867329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] PATH_INFO: `/v3/groups/ab2ef44d70fc413aa27f478b0fee5122` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.878930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] RBAC: Authorizing `identity:get_group(group_id=ab2ef44d70fc413aa27f478b0fee5122)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.881684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.883424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 193/383] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/groups/ab2ef44d70fc413aa27f478b0fee5122 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.897250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.955929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41c798-b001-4bc6-a57b-143a5f23ad99 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.017290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.018213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.018490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.018760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.022708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.024278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.028178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 191/384] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:18.033257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.076330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363c5e-faa9-450b-9ad4-4f9f65e3af8d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.118788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.119451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.119759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.120032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.120860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] RBAC: Adding query filter params (group.id=ab2ef44d70fc413aa27f478b0fee5122, role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=f7b62d8bc2904e559160e9d978cde596) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.121218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.122874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.136565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 194/385] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/role_assignments?group.id=ab2ef44d70fc413aa27f478b0fee5122&scope.project.id=f7b62d8bc2904e559160e9d978cde596&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.218642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.222729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e25be-8522-461d-9afd-7c35b7e865f7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.274072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.274961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.275236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.275517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.280305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.281796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d79cd-9b5f-4223-9753-c2ca15de32b1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.283895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 192/386] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.289929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.336525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.462713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b673fa-9e87-4b71-8105-cb6f77d5eac8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.503355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.504326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.504645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.504915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.507063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, group_id=e0e6f678a1dc491fbaa8dee36977e8c3, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.508774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c50cd4-325f-4865-b2da-39fd89dcb43e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.524899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 195/387] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 26 12:24:18 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:19.350259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fea6-2c3d-4ad6-897d-59d6dfbc2638 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.350802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fea6-2c3d-4ad6-897d-59d6dfbc2638 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.350802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fea6-2c3d-4ad6-897d-59d6dfbc2638 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.352527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 193/388] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:19.357849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.358264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.358428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.384599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:19.385814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:19.410578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d2e9-9235-4361-b06c-20772bf7c4e2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.410884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d2e9-9235-4361-b06c-20772bf7c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.411144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d2e9-9235-4361-b06c-20772bf7c4e2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.413599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 194/389] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:19.419495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.419807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.420088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.438759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:19.440105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:19.483084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 196/390] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:19.532917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 195/391] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:19.536771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.552728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.615588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.657676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d315f1-123e-41b3-8592-6eb3fde9ced7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.701245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.702438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.702916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.703395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.723049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:19.732060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.733007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:19.733787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:19.740965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 197/392] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.746812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.762737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.769042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4157f-9d8b-4e40-a44b-5ee7bd5e4049 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.806219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.806653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.806934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.807212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.817913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:19.828866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.829806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:19.830573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 196/393] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.836664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.846326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.899070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4899e5-b480-4825-a3d7-455cc8cecee5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.945931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.946600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.946879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.947150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.947997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.948225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.949599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.950453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb4737-9fc7-4b71-8b83-7758eb32615f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.966242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 198/394] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:19.975635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.993209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.994295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.995405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.997035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.998001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.998737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.000972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.021952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 197/395] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:20.028554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.074163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.111133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bec5a-f2b5-457a-a146-f0b1cf0ff65f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.145320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.146265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.146545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.146828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.148054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.149675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.151583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 199/396] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.156853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.173920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.210427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764e44-0943-4afc-8467-5459d0a7812f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.246085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.246953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.247236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.247512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.248726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.250186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f136e-962f-4d8a-b571-e1e28c8f2554 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.252244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 198/397] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:20.253430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede2d9-5eb9-4377-afd7-7611a574aeaa None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.253714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede2d9-5eb9-4377-afd7-7611a574aeaa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.253988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede2d9-5eb9-4377-afd7-7611a574aeaa None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.255476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 199/398] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:20.258574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede2d9-5eb9-4377-afd7-7611a574aeaa None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.304397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb8e2-296d-4f20-a203-d956a41d02e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.348155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.349549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.350023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.350401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.351721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.353948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116c306-7986-4ba9-9dfa-19708a0017f1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.359803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 200/399] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.360719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.361498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.361922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.362146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.380254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede2d9-5eb9-4377-afd7-7611a574aeaa None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.388038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:20.389282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:20.425044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.426513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.427962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.428443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.429928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.431829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.440296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 200/400] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.441651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.464493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.470014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 201/401] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:20.471139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.565012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c36f-2515-4ea9-babb-42dedbcfc026 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.586694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208d36-59e2-429b-9f8f-20ae9797bd9c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.603307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.604541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.605066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.605470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.607998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a83c85118e479982e2c6ad490b0b61, group_id=e0e6f678a1dc491fbaa8dee36977e8c3, role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.609656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.623460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.624404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.624727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.625086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.626860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 201/402] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 26 12:24:20 2022] PUT /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:20.627227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, group_id=e0e6f678a1dc491fbaa8dee36977e8c3, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.628030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.628862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.648307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 202/403] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 26 12:24:20 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:20.651568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.804446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d3f0-6a89-43ea-90d7-884e2eb53a99 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.867039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.867941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.868220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.868496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.883432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b2d5a29e-ab51-434d-b2c1-410eae8eb545 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:20.896300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:20.897257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:20.898031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:20.900518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 202/404] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:20.908739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.931211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9893-0ff9-4a5d-9b33-4b88d523039c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.931856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9893-0ff9-4a5d-9b33-4b88d523039c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.932323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9893-0ff9-4a5d-9b33-4b88d523039c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.934202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 203/405] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:20.940453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.941050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.941487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.959480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:20.960951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:20.980874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.040813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de231-359c-4a0a-8db8-8af3087b3fae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.042135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 204/406] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:21.074468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.077518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.091921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.092657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.092937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.093206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.093979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.094283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.095696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.116761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 203/407] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.128560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.201719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85402b-38f1-4436-8ada-978ac2c8295c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.239407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.240718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.242065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.242548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.254585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:21.262694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.263617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:21.264405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:21.267215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 205/408] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:21.272928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.344005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.381912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fdd3f-dcb0-4d9d-9577-9776496de431 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.418710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.419525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.419946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.420313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.421330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.422007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.423517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.433090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 206/409] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.440925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.463642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b7f8-55d6-4d90-8388-63bff0aa6a9a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.499293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.514904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.517335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.518317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.518944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.521172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.524054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.527638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 204/410] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.535575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.645863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4260c-da07-4e72-b21a-69641a441e7c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.694374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.711005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.711911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.712228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.712508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] PATH_INFO: `/v3/groups/ab2ef44d70fc413aa27f478b0fee5122` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.713698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] RBAC: Authorizing `identity:get_group(group_id=ab2ef44d70fc413aa27f478b0fee5122)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.715181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49803d-b4d0-43fe-9a14-3e8044bf6e7e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 207/411] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/groups/ab2ef44d70fc413aa27f478b0fee5122 => generated 229 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045ea5-14dc-4671-a54f-41d8064c3608 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045ea5-14dc-4671-a54f-41d8064c3608 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045ea5-14dc-4671-a54f-41d8064c3608 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 208/412] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:21.722349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045ea5-14dc-4671-a54f-41d8064c3608 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.736015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d07-7852-4f45-8d9c-5bbb1adead7b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.796216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.797511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.798326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.798866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.800561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.803012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0e97c-6862-4158-8507-e4f27078aff1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.805476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 205/413] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.806767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.807172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.807605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.828378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:21.830404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:21.846387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045ea5-14dc-4671-a54f-41d8064c3608 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.881867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.882928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.883300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.883726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] PATH_INFO: `/v3/projects/f7b62d8bc2904e559160e9d978cde596` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.885047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] RBAC: Authorizing `identity:get_project(project_id=f7b62d8bc2904e559160e9d978cde596)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.886694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.893172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 209/414] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects/f7b62d8bc2904e559160e9d978cde596 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:21.893172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.903517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.923568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 206/415] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:21.923568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.979449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.022804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b0a0-2120-4d43-8d0d-836b9bfffa92 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.062343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.063831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.064493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.064908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.068035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] RBAC: Authorizing `identity:create_grant(project_id=57c9519c74c344a8a934bcffef7b0bc7, group_id=e0e6f678a1dc491fbaa8dee36977e8c3, role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.070255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.071463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65e707-7589-48e0-9e74-e9eaf5e5354a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.095787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 210/416] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 26 12:24:21 2022] PUT /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7/groups/e0e6f678a1dc491fbaa8dee36977e8c3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:22.098178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.133128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.134142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.134535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.134809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] PATH_INFO: `/v3/projects/f7b62d8bc2904e559160e9d978cde596/groups/ab2ef44d70fc413aa27f478b0fee5122/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.137077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7b62d8bc2904e559160e9d978cde596, group_id=ab2ef44d70fc413aa27f478b0fee5122, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.138672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.160383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 207/417] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 26 12:24:21 2022] PUT /identity/v3/projects/f7b62d8bc2904e559160e9d978cde596/groups/ab2ef44d70fc413aa27f478b0fee5122/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:22.273553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da7927-e466-4554-a28d-8e8c6904cc89 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.299676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.314910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.315764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.316090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.316365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.335420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:22.343639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.344611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:22.345917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 211/418] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:22.352557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.408065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.462569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6478-eb03-4277-94a7-0768edd60565 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.505706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.507217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.507743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.508288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.509254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.509753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.511365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.523701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 208/419] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.529566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.672975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937b6b-2a62-4dda-aacd-5c9273d6d142 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.718122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.719136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.719628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.720089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.783108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.807043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.808698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.940537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 212/420] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:22.945768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.107827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084238c7-7fee-4af8-8ad4-50340b299a88 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.123155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.154810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.155712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.155993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.156267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.157556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.159015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf8d63-d46e-4d84-87f2-965730ada7c9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.161043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 209/421] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.166646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.256769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade459a-3ed6-446e-87f1-2a931e559354 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.257050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade459a-3ed6-446e-87f1-2a931e559354 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.257324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade459a-3ed6-446e-87f1-2a931e559354 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.260119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 210/422] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:23.264734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.265253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.265816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.291265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:23.292841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:23.309050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.322966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c2ebd-d884-4611-9d2f-87391a5cf419 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.389185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.389972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.390251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.390522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.391873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.393348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.397714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 213/423] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.404420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.423087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 211/424] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:23.446714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.559933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3f11-45c6-4381-9fec-fc4bedce29b5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.572774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bd972-9e7e-4c2d-981a-b39907fb0ecb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.585846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.600559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.601350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.602138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.602506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.603846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=b8a83c85118e479982e2c6ad490b0b61) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.604307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.606303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fe1e5-e32f-4b6d-90cc-1c11a04e52b5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.619777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 214/425] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.621635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f40a79-da94-4f36-867b-4eb4be556e97 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.622067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f40a79-da94-4f36-867b-4eb4be556e97 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.622462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f40a79-da94-4f36-867b-4eb4be556e97 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.625572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 215/426] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:23.627887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.628956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.629386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.629790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.636522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.637052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.637460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.660533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:23.672415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:23.673851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:23.676701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.677826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:23.678816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:23.687803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 212/427] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:23.698054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.700856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.791076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 216/428] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:23.817893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.900749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc029d0-57df-4e0b-ab3c-13256e04f234 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.948865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.949775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.950288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.950686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.951592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.952028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.955422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.965132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 213/429] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.970803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.977554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd5fbe-8d2e-44c4-9f3f-07ad20da1d01 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.006033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.017071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.018224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.018712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.019165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.033621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:24.044727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.045630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:24.046414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:24.049440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 217/430] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:24.056525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.060989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.102325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05981736-47be-4f9d-b078-5a16c4e65b4b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.146604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.147685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.148158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.148613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.182396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ea9b-1e5e-4e88-b19d-aa4b68d89b67 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.224725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.225316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.225593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.225863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.226611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.226961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.229202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.230877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.232652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.239884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 218/431] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.246959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.274842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.322654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.362262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ea24-6fda-4ab3-b2b5-43af730e3aaa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.366747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 214/432] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:24.375577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.403583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.404718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.405192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.405647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.483796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.486044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.499108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5a770-d80c-4df0-b34b-99ff61b4f7b5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.536185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.543963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d034-5018-4254-b243-d89016d7594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.545084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d034-5018-4254-b243-d89016d7594a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.545554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d034-5018-4254-b243-d89016d7594a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.546034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d034-5018-4254-b243-d89016d7594a None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.547400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d034-5018-4254-b243-d89016d7594a None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.549063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d034-5018-4254-b243-d89016d7594a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.551453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 215/433] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.557260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d034-5018-4254-b243-d89016d7594a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.563418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.600869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 219/434] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:24.607152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.672006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d034-5018-4254-b243-d89016d7594a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.707307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.708571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.708983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.709293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.710720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.712333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.714367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 216/435] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:24.719433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb24-bc7b-4250-b061-98f469d1fe38 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.720389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.757525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.758675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.759110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.759572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] PATH_INFO: `/v3/projects/b8a83c85118e479982e2c6ad490b0b61` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.760893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a83c85118e479982e2c6ad490b0b61)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.762483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.764653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 220/436] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/b8a83c85118e479982e2c6ad490b0b61 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:24.770237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.805101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.831156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.853922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983ca7e-9fe2-427f-bcce-abed1a36f689 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.888060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.888716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.888996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.889267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.890107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=68642b462a1f4c3e9599fabc3387b853, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.890417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.891895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed811-f2ca-4e5d-b844-9b1913a6362f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.897968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 217/437] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=68642b462a1f4c3e9599fabc3387b853 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:24.899007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7148-99c5-4567-bc40-47c140bcdcdf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.899293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7148-99c5-4567-bc40-47c140bcdcdf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.899589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7148-99c5-4567-bc40-47c140bcdcdf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.900826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 218/438] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:24.901945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba156416-3737-4e54-ad41-9ca40e86e759 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.902226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba156416-3737-4e54-ad41-9ca40e86e759 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.902504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba156416-3737-4e54-ad41-9ca40e86e759 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.907591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 219/439] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:24.907591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.907591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.907591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.915017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1ecb-5b5e-41cc-9795-8f4a16d1cae2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.928991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:24.930341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:24.953789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.954679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.954961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.955245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.956547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.958114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cf8d0-d38e-46c4-b26b-1570648e7b85 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.959921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 221/440] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.961204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.961491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.961765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.979328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:24.980587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:25.027649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 220/441] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:25.027649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.068880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 222/442] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:25.069559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.100918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.104907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.148545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139360-9e69-4d29-9021-b6a53967ea87 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.181870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.182519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.182794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.183058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.183925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=b8a83c85118e479982e2c6ad490b0b61) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.184188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0adc-8790-4f5d-9d6e-d421c40d7aca None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.184297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.185660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.191368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 221/443] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=b8a83c85118e479982e2c6ad490b0b61&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.192179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.220329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.221164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.221435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.221696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.235926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:25.244649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.245657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:25.246601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:25.248696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 223/444] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.257261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.313776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7c2-7a6d-437b-b1a8-c575a2b56651 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.339678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.351839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.352746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.353023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.353294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.365556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:25.367640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:25.373655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.374777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:25.375654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 222/445] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.380681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.382965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706cc7-e80f-48eb-b51e-02aca4b3b745 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.425798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.427345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.427806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.428220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.429391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.429853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.432095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.444994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 224/446] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:25.451030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.514856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4434232-b007-47bb-932c-4d5ce3eacd39 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.553742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.554421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.554700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.554971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.555787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.556093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.557532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.567591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 223/447] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.570195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539176-7690-4d1e-ba6a-aa1001fdfca9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.573994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.609743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.610743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.611033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.611309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.631151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.638070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.696836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.697473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f146d2-c5a4-4251-b70a-eb25086b5350 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.698318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.736314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.737213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.737678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.737949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 225/448] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:25.816473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.816648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.818664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.867936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.872439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.916570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8334-2a67-4d0b-ae3c-56bc6483c28f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.923066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 224/449] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:25.928714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.950319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.951172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.951444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.951742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] PATH_INFO: `/v3/projects/57c9519c74c344a8a934bcffef7b0bc7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.952945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] RBAC: Authorizing `identity:get_project(project_id=57c9519c74c344a8a934bcffef7b0bc7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.954380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.956086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 226/450] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/projects/57c9519c74c344a8a934bcffef7b0bc7 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:25.961463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.025791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08af3d0-bc9b-4858-9d6a-e71da0683e6a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.056328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d596-b60d-40db-8d16-3b7b25dbbee2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.058182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.059038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.059311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.059602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] PATH_INFO: `/v3/projects/f7b62d8bc2904e559160e9d978cde596` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.060770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] RBAC: Authorizing `identity:get_project(project_id=f7b62d8bc2904e559160e9d978cde596)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.062222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.064094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 225/451] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/projects/f7b62d8bc2904e559160e9d978cde596 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:26.069363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.077981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.084584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.090767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.091654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.091915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.092183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] PATH_INFO: `/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.093360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] RBAC: Authorizing `identity:get_group(group_id=e0e6f678a1dc491fbaa8dee36977e8c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.094808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.096445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 227/452] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/groups/e0e6f678a1dc491fbaa8dee36977e8c3 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.103325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.185000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699458c7-8216-4a5f-b6e5-d1a35907559d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.208506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead30455-14bd-4d5b-800a-31425672594e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.217907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.218769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.219048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.219322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] PATH_INFO: `/v3/groups/ab2ef44d70fc413aa27f478b0fee5122` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.220548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] RBAC: Authorizing `identity:get_group(group_id=ab2ef44d70fc413aa27f478b0fee5122)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.222072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.224343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 226/453] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/groups/ab2ef44d70fc413aa27f478b0fee5122 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:26.229910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.247008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.247695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.247975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.248237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.249073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] RBAC: Adding query filter params (group.id=e0e6f678a1dc491fbaa8dee36977e8c3, role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=57c9519c74c344a8a934bcffef7b0bc7) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.249384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.250837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a91ac3-7f9c-4a29-9b3f-1f77659f7ca6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.257025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 228/454] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/role_assignments?group.id=e0e6f678a1dc491fbaa8dee36977e8c3&scope.project.id=57c9519c74c344a8a934bcffef7b0bc7&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.328009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.348295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555037f-b60c-456f-80c9-9f8456c2f242 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.385591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.386268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.386545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.386815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.387706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] RBAC: Adding query filter params (group.id=ab2ef44d70fc413aa27f478b0fee5122, role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=f7b62d8bc2904e559160e9d978cde596) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.388014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.389467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8dd00-410b-4786-a43a-1220cce93839 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.396597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 227/455] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/role_assignments?group.id=ab2ef44d70fc413aa27f478b0fee5122&scope.project.id=f7b62d8bc2904e559160e9d978cde596&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:29.011359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3850e-f2a0-46b4-8afa-5e8a9497583b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.011941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3850e-f2a0-46b4-8afa-5e8a9497583b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.011941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3850e-f2a0-46b4-8afa-5e8a9497583b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.013595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 229/456] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:29.018598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.019014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.019200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.044625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:29.045856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:29.134756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 228/457] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:29.170810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3850e-f2a0-46b4-8afa-5e8a9497583b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.240981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.313353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3850e-f2a0-46b4-8afa-5e8a9497583b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.363385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.364299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.364580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.364851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.375953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.377430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2ef11611-2965-4ce8-80e9-5eff251cc94a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:29.406961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.407931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.408784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:29.408784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:29.408784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.408784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:29.408784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 230/458] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.414538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.430281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c13d-f035-4c47-baa7-3e6037e663d5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.430578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c13d-f035-4c47-baa7-3e6037e663d5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.430828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c13d-f035-4c47-baa7-3e6037e663d5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.432527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 231/459] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:29.440716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a77a-bbf6-41ee-b9a0-161fecf9d086 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.441000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a77a-bbf6-41ee-b9a0-161fecf9d086 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.441272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a77a-bbf6-41ee-b9a0-161fecf9d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.468642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ecc0a77a-bbf6-41ee-b9a0-161fecf9d086 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:29.469847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ecc0a77a-bbf6-41ee-b9a0-161fecf9d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:29.511350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.548651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c454-ef3a-457f-b70a-ccf2e8bc71ab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.551872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 232/460] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:29.553564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1354b-526c-41a5-86e5-c2e05944c57f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.553996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1354b-526c-41a5-86e5-c2e05944c57f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.554405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1354b-526c-41a5-86e5-c2e05944c57f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.556119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 233/461] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:29.569071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.569549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.569958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.590621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:29.592560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:29.609836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.610738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.611659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.612648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.614369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.615523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.618720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.627790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.649633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 229/462] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.649633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.687515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 234/463] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:29.689229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.794852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b744e9f-7fca-4b86-9772-2287bb776f90 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.827785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdcf0e-936e-4ffe-b371-7359ae94b657 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.831128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.831460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.831762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.832032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.835277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.845822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.847353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:29.866033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.867034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.867903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:29.867903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:29.867903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.867903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:29.871798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 230/464] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.872852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.876675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.878535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.879016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.879592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.880722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.882393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.913815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 235/465] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:29.915151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.952304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.033974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0933-29b5-44df-8956-8d6d8b4cc424 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.069032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02ae0-08a3-4304-bf78-e215bd93ce69 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.077436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.078724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.079207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.079720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.093844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.095775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.109205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.110381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.110655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.110920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.111738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.112046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.113481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1893e7-d237-422e-a9ea-cc19c24e7cf5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-978c2f8c-8a3a-44ec-8d29-57cbfa2a78a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:30.118873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.119841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.120693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:30.120693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:30.120693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.120693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:30.122838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 231/466] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:30.129520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff070-1839-4610-9bae-f7619c7eecb9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.130846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff070-1839-4610-9bae-f7619c7eecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.131354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff070-1839-4610-9bae-f7619c7eecb9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.133589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 232/467] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:30.134624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff070-1839-4610-9bae-f7619c7eecb9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.137122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 236/468] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.140918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.141210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.141483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.162015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:30.164465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:30.192877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.260709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 237/469] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:30.261674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.282009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff070-1839-4610-9bae-f7619c7eecb9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.293784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.322219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.323269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.323799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.324254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.325211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.325697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.327363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.344415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 233/470] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.346455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.409062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723973c2-db0b-427e-bd95-fbc0e6ea5ec1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.451298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.452116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.452397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.452756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.453376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.454963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.467875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.471251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cedf6-f9c0-4fd8-b6bc-60dec33556e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.487569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 238/471] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:30.487569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.511449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.512395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.512746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.513090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.525967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.527723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c69477c4-75b2-418f-917a-32d2142bed8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:30.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.549177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:30.549177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:30.549177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.549177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:30.549177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 234/472] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:30.550519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77e8c-05d7-4f52-a345-372c1f231c9a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.550898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77e8c-05d7-4f52-a345-372c1f231c9a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.551372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77e8c-05d7-4f52-a345-372c1f231c9a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.553213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 235/473] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:30.558385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77e8c-05d7-4f52-a345-372c1f231c9a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.597167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.647331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c5d3-ab31-4d59-8b9e-658c1c8611d9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.687219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.687677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77e8c-05d7-4f52-a345-372c1f231c9a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.688124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.688472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.688814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.689597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.691786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c3902-32a5-48c4-a519-a1d7ae51653d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.717052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 239/474] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:30.719386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.720162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.720901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.743098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:30.744923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:30.746323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.747082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.747465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.747912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.749182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.749442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.752235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.772647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 236/475] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.776448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.798400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.841303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 240/476] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:30.869284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.922414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14834-2465-40e4-93c7-22b50ab64e1f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.937512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.960464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.961311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.961683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.962049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.962849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.964417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.991503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19219ffd-aed6-46f4-8647-af0e13274d24 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.991785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 237/477] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:31.037015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.038088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.038512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.038924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.039882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.041550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.049858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.sql.core [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:31.049858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:24:31.049858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [parameters: {'id': '406a12f5cc2545ab8589ecc1e0c865f4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:24:31.049858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80218) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() May 26 12:24:31.068041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return ref.to_dict() May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:31.069216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application yield resource May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise self.value May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application session.commit() May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:24:31.070808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.flush() May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application compat.raise_( May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:24:31.071900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:31.072963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:31.073966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [parameters: {'id': '406a12f5cc2545ab8589ecc1e0c865f4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.074970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:24:31.076084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:31.079046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 241/478] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:31.085775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.168633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.209823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57fe77-1963-4224-826a-a5442c99b5c9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.250050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.251207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.251698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.252142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.264999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-22b94658-4a6f-4e65-86ba-a8056d67ab47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:31.274390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.275349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:31.276171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:31.278650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 238/479] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.284631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.392570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3ef9-cf9d-4b53-a987-49ab2b7ab3d4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.411620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.431730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.432640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.433084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.433573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.434471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.434989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.436647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eac76-13a1-4770-a220-5ed84b3f3f6d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.446921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 242/480] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.447061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e9f0-e8dd-4c03-974e-53514e7a900a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.447656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e9f0-e8dd-4c03-974e-53514e7a900a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.447656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e9f0-e8dd-4c03-974e-53514e7a900a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.449279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 239/481] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:32.454578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.455001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.455134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.476598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:32.477837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:32.555682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 243/482] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:32.594508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15e9f0-e8dd-4c03-974e-53514e7a900a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.712776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15e9f0-e8dd-4c03-974e-53514e7a900a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.751938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.757273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.758325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.758903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.759375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.772882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:32.781059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:32.782205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:32.783193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:32.785701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 240/483] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:32.795142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.934749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc643fe6-d692-4765-b541-ca8aa614dc19 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.946037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.979109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.979728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.980013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.980289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.981052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.981355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.982753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.992542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 244/484] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.998155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.181041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6cd67-989c-4e5d-ab38-2c9b5e211173 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.236321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.237038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.237314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.237583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.251815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.253285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:33.273908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:33.274797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:33.276419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:33.276419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:33.276419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:33.276419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:33.276419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 241/485] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:33.282612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.450423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a01b6-a1a2-4f33-8f89-64d99fa3ffda None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.512095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.512742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.512987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.513217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.513958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:33.514256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.515687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199e2a-0a3a-40b9-9790-db31f241747e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.528731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 245/486] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.534658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.601646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.616685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862f0d-7161-4e07-a858-9c588c30819d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.617314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862f0d-7161-4e07-a858-9c588c30819d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.617871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862f0d-7161-4e07-a858-9c588c30819d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.619724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 246/487] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:33.624889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc64e4-1817-4e89-85c3-820b7635dd9c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.625397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc64e4-1817-4e89-85c3-820b7635dd9c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.625874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc64e4-1817-4e89-85c3-820b7635dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.643340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1fbc64e4-1817-4e89-85c3-820b7635dd9c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.644978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1fbc64e4-1817-4e89-85c3-820b7635dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.674937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.683444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb335a0-739a-4e07-9426-db9a1efadd49 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.723508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 247/488] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:33.731685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30726e-b047-4918-af58-2a86b52ca04f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.731685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30726e-b047-4918-af58-2a86b52ca04f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.731685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30726e-b047-4918-af58-2a86b52ca04f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.731685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 248/489] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:33.732239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.732582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.732766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.737230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.738631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.739138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.740489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.749735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.751417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.763905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.765160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:33.769973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:33.771061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:33.772189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:33.774460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 242/490] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:33.775519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.863950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 249/491] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:33.865165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.921125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.924615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824d7b-33fc-4d49-864c-dae0cbf8def7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.960102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.960903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.961175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.961439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.963334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.972828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885ba-23a3-4d9f-b660-d1d67504b3e8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.973305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:33.981916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:33.982914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:33.983732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 243/492] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:33.984758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.014201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.015322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.015826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.016293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.017344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.017880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.019529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.056308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 250/493] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.057540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.108696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288855-240f-4fe2-97fa-55b1f5d5a190 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.145309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.146143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.146384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.146652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.157432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-cb70041e-4e3c-4ac9-b74a-4159c1453fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:34.165695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.166723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 244/494] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.172413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b56a9-1e9d-493d-8382-a70e71b71a55 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.173115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b56a9-1e9d-493d-8382-a70e71b71a55 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.173115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b56a9-1e9d-493d-8382-a70e71b71a55 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.173115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 245/495] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:34.173115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b56a9-1e9d-493d-8382-a70e71b71a55 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.176137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df79ed-fe75-44b7-b81e-956079f00b57 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.194597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.210555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.211236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.211519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.211826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.212583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.212892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.214307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.223131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 251/496] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.224105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.240868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.283983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b56a9-1e9d-493d-8382-a70e71b71a55 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.317922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.318589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.318865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.319131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.325073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4982-1ea1-47f4-88cc-1dca42f3db77 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.358969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.360018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.360297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.360563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.361300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.361605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.362993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca099859-75e6-4eef-b58a-ba39819fc40b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.370968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 252/497] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.372160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.372442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.372713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.387029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.388547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8856-ef1f-46f3-a2ee-6616a8932593 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.388715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:34.389888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:34.408817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.454449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 253/498] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:34.455192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.468795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.489247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 246/499] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:34.490689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939623-abf4-4359-b7a9-9494a803ebe3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.490993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939623-abf4-4359-b7a9-9494a803ebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.491265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939623-abf4-4359-b7a9-9494a803ebe3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.492539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 247/500] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:34.493283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939623-abf4-4359-b7a9-9494a803ebe3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.573390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0f83-4a9d-461e-9f6e-175cc80dfaed None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.600843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939623-abf4-4359-b7a9-9494a803ebe3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.607344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.608173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.608452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.608725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.619249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.620771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.620900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.635642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.636432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.636707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.636970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:34.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.638916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.639813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:34.639813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:34.639813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.639813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:34.639813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 254/501] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.640075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.651633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.653082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:34.671149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.672042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 248/502] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.677904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.697861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.741080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d6abe-598b-409a-a5ee-41e757164d90 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.770516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5900-69b8-4aac-9a29-16b9f0a18fb5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.777384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.778215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.778491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.778753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.790543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-60fc5d24-9cbc-49f4-b342-a38edf90cba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:34.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.799195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:34.800019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 255/503] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.800676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.801092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.801399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.808118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.809001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.809283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.809552 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.817569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:34.818749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:34.819986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.821418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:34.838983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.839881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.840706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:34.840706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:34.840706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:34.840706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:34.840706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 249/504] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.841191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.866718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.889203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 256/505] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:34.890029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.936907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.949108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c703-3b3b-47e7-9e50-afbad3818657 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.983067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.983778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.984400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.984652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.985387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.985692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.987057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.993228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfae718-790b-46ac-9358-d56283e76cfb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.997994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 250/506] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.998839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.033774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.034435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.034711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.034979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.035987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.036293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.037696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.048860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 257/507] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.049642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.090815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.107737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cc1c5-265b-4d35-b017-1960feb3f463 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.141217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.141880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.142157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.142427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.143178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.143508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.145190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.149719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab17-e6d9-4025-b3f5-48446e21526b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.152882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 251/508] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.153658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.157326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.184980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.185643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.185931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.186205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.186929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.187236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.188679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.200507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 258/509] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.201469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.258985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ef34-53a3-464f-89f9-9de82a38d72a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.294818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.295633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.295893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.296160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.298902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad3d7-2a76-4ed6-9d9e-bdaf54440cc1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.307837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.309307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.315716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:35.327295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.328196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 252/510] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.329313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.336035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.336841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.337121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.337391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.345292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.346690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:35.363190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.364256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:35.365156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 259/511] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.366049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.393743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.427283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e480-7180-4292-8d86-b7e44e71e77f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.460539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.461341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.461621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.461897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.463569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66fd5-a5d5-4548-92c5-a35fa1f9b8eb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.470261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.471779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:35.491043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.492150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 253/512] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.498111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.506628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.507435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.507749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.508026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.519134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.520772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:35.538520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.539504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.540372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:35.540372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:35.540372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.540372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:35.540372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 260/513] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.540624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.558734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.600664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f196d-62ce-4aee-99f4-ad65f9d3734d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.621223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.635103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.635927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.636207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.636478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.642574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688534-7618-4250-a0e6-bb20597158f3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.643187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.644705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:35.659418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.660572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:35.661441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 254/514] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.661908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.679709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.680353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.680629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.680894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.681602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.681895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.683289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.696041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 261/515] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.696847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.760053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b298c6-2608-4f84-aafc-031e59739f46 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.777587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.795007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f82c-a182-41a7-b85b-49fd4e8bb0cc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.798206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.798881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.799158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.799427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.800299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.800602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.802161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.828677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.829354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.829613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.829878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.830704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.831007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.832692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.838717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 255/516] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.839553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.840602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.851901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 262/517] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.852896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.939211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac73-38af-40fb-bda2-cb08126befc3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.952311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c300f9-5e99-44ba-9642-195a1c4d7e69 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.972384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.973157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.973437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.973716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.974474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.974771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.976215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.984997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.985663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.985921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.986195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.986972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.987272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.988009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 256/518] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.988829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.988928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.008846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 263/519] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.009665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.030314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.065075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.098844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533756cd-dd58-4fab-859d-c4d322f5aa9a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.107947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b16-4a3b-4d14-82fd-80f6fe049a91 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.130949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.131638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.131916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.132182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.132888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.134330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.140549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.141191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.141469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.141741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.155559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 257/520] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:35 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:36.156381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.216219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.217782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.278395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.282699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.295703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127963d9-cc14-4e4b-bdc9-ba73f10696e8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.329172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 264/521] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:36.330296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.340153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.340815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.341227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.341485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.420432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.421835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.440580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d838a-e4d3-4f3a-8a17-8063d541474b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.476457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.477348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.477737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.478004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.486118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.487628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:36.504031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.505206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 265/522] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.506083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.514438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.527982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 258/523] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:36.529094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.532995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.626170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea786d-940b-46f7-b5fc-223df31eed6d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.646634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48efb-e6f7-4b6f-8223-5e84a5b87ae8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.661925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.662649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.662933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.663205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.664083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.664392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.665843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.671955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 266/524] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.672666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.696914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.698382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.698664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.699083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.713243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.715831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:36.740381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.741416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.742231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:36.742231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:36.742231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.742231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:36.747563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 259/525] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.748883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.789879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.810008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4885f-4bd6-4104-aa25-5f4058c71c34 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.813908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.852471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.853502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.854014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.854418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.855442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.855920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.857785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.875112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727b995-2adb-4092-9707-3d351d02f96a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.879312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 267/526] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.880430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.915820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.916630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.916909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.917181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.929569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.931075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:36.949872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.951055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.951941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:36.951941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:36.951941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.951941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:36.951941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 260/527] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.952218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.989913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f350-6a63-4a1b-8406-4e9b3d8f4205 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.026617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.027522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.027963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.028437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.029475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.029936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.031462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.038438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.048716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 268/528] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.049735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.063334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.069962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a221b-f02f-4dda-8d0f-f320d7ba22ee None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.107413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.108517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.109406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.109867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.155561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df6c90-a02e-42cc-90ec-3ab700ed0ddb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.183017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.184839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.190889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.191607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.191886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.192153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.192872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.193173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.194688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.207641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 269/529] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.212270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.273467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.313910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.326075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 261/530] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:37.326075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.339053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232029b0-3a8c-48e8-be1e-201434ecf4a7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.387873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.389662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.390389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.390860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.401420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.403745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:37.422233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.423121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:37.424004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:37.426843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 270/531] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.427942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.428543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442d67-da48-45f7-aca9-cd3961f94301 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.463671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.464547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.464740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.465006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.471925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.473415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:37.487738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.488763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:37.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 262/532] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.490125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.551992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.553100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640958b-50b4-4ed9-bc75-e1651b5807ff None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.576127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.595413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.596816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.597273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.597933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.600689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0aca-9b17-44ea-bfff-0d080fc6f9ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.610166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.611996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:37.630944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.632358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.633189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:37.633189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:37.633189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:37.633189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:37.635458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 271/533] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.636744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.637454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.638179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.638520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.638856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.639811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.640452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.642137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.660659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 263/534] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.662044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.747387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee41ae-85a8-48c6-a97a-667ef4251116 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.761815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65c41-53f3-4040-b6a1-dc5fdda1d623 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.778610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.788562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.790172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.790596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.791001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.791976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.792501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.794196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.798048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.798860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.799230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.799632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.800554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.800886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.802424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.814841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 264/536] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.815082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 272/536] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.815952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.816813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.850336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.934498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718109a-47e7-4013-90a6-698a5ec5b3ab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.935197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd390e-80d4-4e14-a23e-d9837e957d73 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.976623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.977300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.977563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.977830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.978423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=0b164dd7ea5b474d85d541ad7815f1ac) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.978963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.979511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.979964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.980369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.980475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.981427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=7df29f2915c446f5b3c0ed3cfb14a89a) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.981874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.984299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.990070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 265/537] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/role_assignments?user.id=0b164dd7ea5b474d85d541ad7815f1ac&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.990957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 273/538] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/role_assignments?user.id=7df29f2915c446f5b3c0ed3cfb14a89a&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.991349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.042914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.114966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a2be-6d39-4384-a18b-910c5fdc3907 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.153378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.154251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.154532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.154851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.163113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.164637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:38.180644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.181558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:38.182381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 266/539] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.188927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.323092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.330299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2b8f-4c7b-4433-99dd-046761b7c9c2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.376553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.377233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.377508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.377784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.378631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.378968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.381150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b22d8-95ea-44ad-9b0a-bce4acbc3085 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.395138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 274/540] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.401345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.449791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffb2-e952-492c-869f-95726b57bf75 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.450153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffb2-e952-492c-869f-95726b57bf75 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.450360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffb2-e952-492c-869f-95726b57bf75 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.452030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 275/541] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:38.457529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.457818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.458091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.490178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:38.491389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:38.520385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.527931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b15b6-7bab-4f10-bad4-4af2f412ecc1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.580589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.581836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.582354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.582815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.583911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=33e60332dbea4c4e9e6884f5effd0d09) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.584434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.586631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.593411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 267/542] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/role_assignments?user.id=33e60332dbea4c4e9e6884f5effd0d09&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.643897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 276/543] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:38.685233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.828200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4229fe2-298e-4b82-b940-68b0976702ec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.876753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.877485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.877769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.878041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.896475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:38.904271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.905155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:38.905924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 268/544] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.912757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.041633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.063801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225442-a03b-42e0-b116-19c44433fdb3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.106550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.107220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.107505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.108056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.109175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.109481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.110873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c72ba1-8f39-4921-b80a-d806ae8234e9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.125544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.127725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 277/545] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.171795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6eac7-4c7a-42f2-b4e7-a2b66621395e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.172117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6eac7-4c7a-42f2-b4e7-a2b66621395e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.172376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6eac7-4c7a-42f2-b4e7-a2b66621395e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.177254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 278/546] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:39.180149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.180433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.180705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.200891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.209074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:39.210298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:39.328926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 279/547] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:39.340695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21871f09-4f7f-499c-ae50-6eee6dee5c91 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.353945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.403900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.404647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.404917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.405196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.431231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.432756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:39.462884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.463813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.464724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:39.464724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:39.464724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:39.464724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:39.464939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 269/548] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:39.472788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.504489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.531392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a27e-fa9e-496d-ac5e-26c2986d1187 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.567798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.569722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.570174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.570623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.583782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:39.594326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:39.594577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.595867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:39.596992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:39.598090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 280/549] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:39.604465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.613706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886219e-65a8-4a38-ba31-18a08fb17552 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.715369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede76-0de7-477c-8917-9925536a9e70 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.739507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.740286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.740567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.740840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.741579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.741883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.743282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.758902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.759594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.759880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.760157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.760923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.761232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.762635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.767841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.772282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 270/550] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.777441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.780527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 281/551] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.788813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.898403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b0b5-c143-4cf6-8c39-0ff696e72aa1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.934885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.935893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.936275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.936647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.948408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.950033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.966365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aad0-3de5-4524-a48a-b04f73fe106e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:39.968319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.969405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.970543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:39.970543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:39.970543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:39.970543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:39.972111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 282/552] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:39.983098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.001841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.002649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.002927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.003198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.006333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.011641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.012969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:40.028451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:40.030597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:40.032768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 271/553] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:40.039556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.040720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.096853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d3ea-c99e-482e-bbbe-fd285a64d7d5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.134346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.135090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.135437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.135746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.136480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.136788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.138085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941b35-d974-4649-9c89-80873f103178 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.138259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.151844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 283/554] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:40.157560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.201794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.202492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.202776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.203053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.203942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.204253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.205707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.246571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 272/555] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:40.252322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.357949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a846-e632-4187-a59d-eedb5a3838bf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.363858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.385235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.416162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad68c2-68fb-4f49-b22f-d61b74231daf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.454026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.455049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.455525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.456012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.496279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.497164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.497386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.497660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.528452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.529946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.531845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.533522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:40.567503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:40.569072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:40.569984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:40.576120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 284/556] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:40.584325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.623945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.723420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 273/557] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:40.741650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.794950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fca11-5732-4453-a237-a94a2382b1b0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.832917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.834009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.834505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.834969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.836035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.836554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.838259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451a85-ebe9-4387-8d7b-63b6f65dc780 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.858115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 285/558] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:40.860188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e87-6532-4a0a-b077-75a0ab40c99f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.860669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e87-6532-4a0a-b077-75a0ab40c99f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.861157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e87-6532-4a0a-b077-75a0ab40c99f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.862843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 286/559] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:40.864029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87e87-6532-4a0a-b077-75a0ab40c99f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.893716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.922190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12abe52-991d-4142-b2c7-b63be36c4a55 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.959134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.959961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.960240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.960503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.970813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.971003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87e87-6532-4a0a-b077-75a0ab40c99f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.972378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d795b6ad-f895-4e51-a534-544147079190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:40.992561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:40.993525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:40.994386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:40.994386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:40.994386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:40.994386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:40.994386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 274/560] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:40.995147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dce9-08fe-45b4-91eb-831661be8826 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.995426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dce9-08fe-45b4-91eb-831661be8826 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.995744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dce9-08fe-45b4-91eb-831661be8826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.007877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.014773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4bb5dce9-08fe-45b4-91eb-831661be8826 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.016037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4bb5dce9-08fe-45b4-91eb-831661be8826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.018496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.020252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.020678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.021082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.034057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.036505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d53bbea9-165d-4452-b873-0ae0ec27468f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:41.056124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.057183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.058212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:41.058212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:41.058212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:41.058212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:41.059995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 287/561] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:41.061360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1cbc3-05f8-4883-b8ac-69bdeac2d58b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.061641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1cbc3-05f8-4883-b8ac-69bdeac2d58b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.061910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1cbc3-05f8-4883-b8ac-69bdeac2d58b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.063286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 288/562] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:41.068160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1cbc3-05f8-4883-b8ac-69bdeac2d58b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.102856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 275/563] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.102856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.102856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.102856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.115563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.117024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.164227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.185827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1cbc3-05f8-4883-b8ac-69bdeac2d58b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.194978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 276/564] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.196219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.220607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.221266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.221544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.221812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.222591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.222886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.224299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.236014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 289/565] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.236807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.270215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.304771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563e956-4807-487f-af3b-16bc6d706449 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.332764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28851bd5-66dc-4bbd-b353-c0e5c1304fe5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.338569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.339236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.339510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.339807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.340526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.340822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.342192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd9f4d-06a9-4fbb-80e4-6e054f2e20ea None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.354967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 277/566] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.356142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e7b-265f-4724-8edc-875aad5ad08f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.356426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e7b-265f-4724-8edc-875aad5ad08f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.356677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e7b-265f-4724-8edc-875aad5ad08f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.357943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 278/567] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:41.363622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116e7b-265f-4724-8edc-875aad5ad08f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.368011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.368822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.369100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.369371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.378120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.382129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:41.390068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.391156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:41.392119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 290/568] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.393198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.471282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116e7b-265f-4724-8edc-875aad5ad08f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.495110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2c24-d676-4848-8728-73a0fef508c1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.497880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.507179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.508011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.508289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.508559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.518847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:41.526439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.527589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 279/569] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.528922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.530960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.531806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.532089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.532558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.541288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.542782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e7f30188-44d1-4575-af4d-2ac45d15fe25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:41.557773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.558820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 291/570] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.560623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.561349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.577699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.578892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.634011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f4ef-23b8-4eb2-b68d-62930050d4c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.636030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.649347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 292/571] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.650178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.670789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.671632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.671915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.672219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.679397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.680888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:41.694830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.696000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 280/572] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.697192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.745286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.755082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f55ab-c7fb-4b56-a518-660c50bf8b85 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.789401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.790076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.790354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.790625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.791379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.791714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.793119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.800406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2809-9534-4ab7-83d8-3cd03967bbd1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.801270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 293/573] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.802057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.835914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.836591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.836875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.837152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.837913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.838216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.839623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.847843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 281/574] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.848838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.856193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.905013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721908-738b-47e1-be7a-5fbad2bcaf69 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.940299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.940996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.941275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.941545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.942336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.942640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.944151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.948404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb6f7-8360-4ac8-885a-caba3af2a73e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.956480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 294/575] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.957443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.969002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.984739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.985545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.985829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.986095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.996919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:42.005139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.006079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:42.007165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 282/576] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.008099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.068510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbb43b-2b45-46b6-903e-430580e2ec77 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.082117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.102640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.103301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.103608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.103883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.104666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.104970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.105586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247516e-b6be-495b-ab85-3114bd2603a3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.106438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.118500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 295/577] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.119280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.139269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.140097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.140371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.140640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.150973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.152437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:42.169062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.169937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.170802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:42.170802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:42.170802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.170802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:42.170802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 283/578] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.171487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.193879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.221444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606d824-848e-4db4-8865-062f8cef6aa4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.262100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.263282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.263738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.264152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.271004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b4450-92fe-4610-9794-26d6520df736 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.279245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.281572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:42.300300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.301263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.302118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:42.302118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:42.302118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.302118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:42.302118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 296/579] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.302403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.313667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.314327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.314607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.314921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.315825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=6fbd6a83714a4d88ae001e7ed462fa86) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.316220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.317761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.323729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 284/580] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/role_assignments?user.id=6fbd6a83714a4d88ae001e7ed462fa86&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.324497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.333812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.428265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e76d4-444e-48c2-8d44-aad6fdd66eb3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.439698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.459420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b15d84-827e-464f-b6b6-7d47f9c65ce1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.466323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.467003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.467290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.467590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.468355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.468658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.470080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.479260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 297/581] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.480166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.503366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.504410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.504761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.505103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.522593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=29b77d3d3a1345f98194174676e35873, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.524213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.541032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 285/582] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:42 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:42.548050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.602686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.618386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce961cb-25ac-40ae-a554-a137bae8773f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.659931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43369ff-aa16-41f1-876a-d3e3df5014c7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.662226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.663751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.664071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.664345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.665108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.665417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.666904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.682675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 298/583] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.683793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.704661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.706189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.707022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.707476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.708656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.709492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.711145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.713913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.732353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 286/584] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.733941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.819835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5ce4-775f-4035-b33f-bb26428df24a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.863206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.864193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.864470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.864746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.878536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.880216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.880577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0fa-26d3-495d-b67e-e96f10d2ab3e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.889063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:42.903240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.904368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.905348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:42.905348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:42.905348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.905348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:42.911637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 299/585] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.912538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.925711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.926652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.927027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.927402 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.935701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.937211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:42.951853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.953019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:42.954162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:42.956739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 287/586] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.958819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.014974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.023515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318267-819e-4b21-9c26-dd1eaf22f030 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.061124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.061877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de9c6-b4dd-4c3b-ac3c-76612c5dd825 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.061991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.062205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.062479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.070740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.072474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:43.088965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.089974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 300/587] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.091498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.101929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.102927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.103406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.103967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.104925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.105424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.106999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.120248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 288/588] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.121580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.180074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.210202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995bbd-115b-4b41-8e4f-85147531e429 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.228877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e008-8faf-4422-9079-c6dd6b62ce5f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.245090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.255394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.256120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.256405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.256679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.257986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.258437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.260144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.268338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.269336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.269959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.270427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.271467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.272025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.273705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.279649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 301/589] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.280508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.293675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 289/590] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.295002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.381765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc53b-502d-4f89-a787-ee442f2be261 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.397148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22a973-9e44-4b53-ab2c-f563eff3aad7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.416765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.417630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.418083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.418392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.426422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.427974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.431872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.435018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.436102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.436580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.437043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:43.444872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.445826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 302/591] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.447471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.452651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.454394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:43.474509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.475451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.476382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:43.476382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:43.476382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.476382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:43.478811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 290/592] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.480043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.507765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.553817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef5ea-9253-4eb2-bb04-11dd40cecd60 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.587489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422298ed-ef28-4696-82c3-24aadcd9f171 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.588588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.589398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.589680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.589968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.600915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.602401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:43.620816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.621771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 303/593] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.623245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.629994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.630680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.630961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.631238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.632315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.632628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.634080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.655651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 291/594] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.656672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.667254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.753647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6d42-f88e-45e2-bc67-35a07fe94db0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.757712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.783282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fd65-891b-4f34-b3cf-1019fdb3184d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.793611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.794494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.794921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.795345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.796265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.796716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.798264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.815378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 304/595] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.816593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.820955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.821627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.821904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.822183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.822907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.823206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.824943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.836928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 292/596] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.837745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.924314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.948270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321882f-efd6-446a-a995-d9946cafa489 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.968597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac7c5-f7d1-4aa3-9a39-7460c8a5f2c0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.994290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.995098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.995388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.995696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.007046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.008645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.016010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.017118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.017672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.018139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.026638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:44.027009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.027918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.028818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:44.028818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:44.028818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:44.028818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:44.028818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 305/597] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.029520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.031341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:44.049728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.051840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.052754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:44.055564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 293/598] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.056649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.059813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.144402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ac493-c819-40d4-b761-cc9c7a580f63 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.175571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc075-38df-4ba3-bd01-75b692b0cad7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.182743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.183568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.183868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.184145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.191878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.193383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.196631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:44.211458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.212461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.213347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:44.217460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 306/599] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.218485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.226583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.227747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.228231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.228723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.229791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.230295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.233615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.248489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 294/600] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.249814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.324763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.340302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefabab-d7fa-4e4e-96bf-b020cbe2e61e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.372996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ba925-7c0d-416a-9324-4dbc087b0144 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.382986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.383416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.383754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.384034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.384835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.385147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.386781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.404852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 307/601] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.405901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.417102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.418210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.418786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.420896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.421950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.422467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.424356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.440356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 295/602] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.442343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.486517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.536722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81139b-bdad-494b-a23e-9f85e09747c0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.565093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209cb3-f936-4532-81d3-1475f26a6ee6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.578076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.578791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.579070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.579337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.587335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.588860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.598023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:44.606689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.607636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.608905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:44.609329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 308/603] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.610857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.615169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.616454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.616960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.617433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/0b164dd7ea5b474d85d541ad7815f1ac/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.635065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=0b164dd7ea5b474d85d541ad7815f1ac, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.637162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.652719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 296/604] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:44 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/0b164dd7ea5b474d85d541ad7815f1ac/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:44.653995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.741317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07019-78ec-4ab0-90e6-f67df51bea3e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.783456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.784116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bc8b-918a-4869-aaf7-7b7f32dde447 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.796616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.797553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.797833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.798113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/7df29f2915c446f5b3c0ed3cfb14a89a/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.823198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=7df29f2915c446f5b3c0ed3cfb14a89a, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.826067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9717ef-61a4-491f-9ae0-a89d0b347f34 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.838242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.838813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.839316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.839850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.840809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.841127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.842630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.849655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 309/605] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:44 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/7df29f2915c446f5b3c0ed3cfb14a89a/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:44.851570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa273-ba3b-460c-8bf1-53eeb2809c0a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.852173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa273-ba3b-460c-8bf1-53eeb2809c0a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.852707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa273-ba3b-460c-8bf1-53eeb2809c0a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.854963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 310/606] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:44.861606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea475-fd34-4b17-912b-df4d8210a49e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.861989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea475-fd34-4b17-912b-df4d8210a49e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.862174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea475-fd34-4b17-912b-df4d8210a49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.866398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 297/607] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.875209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.912544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-388ea475-fd34-4b17-912b-df4d8210a49e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:44.913797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-388ea475-fd34-4b17-912b-df4d8210a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:44.922987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.003412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 311/608] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:45.005530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9daa-306d-4d19-922d-49ae80c44786 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.005822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9daa-306d-4d19-922d-49ae80c44786 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.007394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9daa-306d-4d19-922d-49ae80c44786 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.009023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 312/609] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:45.016254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.017035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.017314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.045898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:45.047096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:45.047743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fc187-d119-4c02-b2b7-95771693f154 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.101671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.102985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.103783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.104330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/33e60332dbea4c4e9e6884f5effd0d09/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.122946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=33e60332dbea4c4e9e6884f5effd0d09, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.124660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.145502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 313/610] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:45.145824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.152045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 298/611] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:44 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/33e60332dbea4c4e9e6884f5effd0d09/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:45.173275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.186176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.309862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db038-446b-4e16-9ee3-e87dbc6cbd92 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.342709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.349786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.350609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.350890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.351164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.357203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea96c-fce4-4066-9516-192622fdf176 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.372169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:45.382039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:45.382996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:45.383917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 314/612] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:45.390182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.418066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.418887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.419163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.419432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.440943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:45.452044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:45.453033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:45.453860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:45.457868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 299/613] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:45.469024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.504752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.516433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506503-82ca-4b3a-92ec-699d53f0ba16 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.563069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.563791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.564134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.564339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.565104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:45.565461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.566872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.591949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 315/614] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:45.600619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.627599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7a83-211f-4dec-9d0e-e99afb070162 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.664397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.665484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.665977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.666449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.667401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:45.667959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.669666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.679563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 300/615] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:45.685248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.691884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.829459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841756-1887-44b5-966f-6b193e638802 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.888593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3950fde-bd5b-488b-99ab-dc832d980aae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.895309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.896146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.896423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.896690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.920339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.922184 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.935802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.937159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.938504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.939181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:45.947985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:45.948943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:45.949866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:45.949866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:45.949866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:45.949866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:45.959513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 316/616] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:45.969369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.971123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.974015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.979046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:46.013675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.014648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.015527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:46.015527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:46.015527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:46.015527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:46.023169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 301/617] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:46.025333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.130431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.133793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd118-1eb6-4b0d-ab38-14cb15af006c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.210084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6baf83-f92c-41ff-bd9c-978e02b46afa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.229598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.230276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.230555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.230830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.231572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.231880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.233712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.259975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 317/618] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.260964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.261898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.262395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.262886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.263858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.264602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.265676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.270492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.295637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 302/619] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.301601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.379667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.443772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a9d2-a94d-4159-a5bd-e7eaa1c7542e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.456417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cd1d8-c5a8-4dbb-9632-a718d926dfe2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.473344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.494751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.495562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.495849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.496122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.511316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.512704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.514372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.517033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.517746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.518963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.536324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:46.546973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.548031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:46.548968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:46.552508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.555103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 303/620] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:46.563891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:46.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.588802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:46.589730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:46.593197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 318/621] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:46.599951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.757280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf779-e48a-463c-88b4-8bffbec7c8d5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.798515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55a33-4349-4425-b2b1-9f054e23b224 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.825739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.826880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.828312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.830236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.831365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.833234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.834900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.843053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.855736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.856746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.857242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.857719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.859107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.859686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.861410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.865973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 304/622] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:46.872085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.881301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 319/623] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.886895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.906369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.974406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317caef-a430-4d4f-ab8f-5d6c6503aff4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.997169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81342d-3285-48b1-9946-25b812b0d85b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.023006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.023637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.023921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.024194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.068122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.068973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.069261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.069533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.095016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.096656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:47.138590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:47.140032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:47.140896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:47.140896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:47.140896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:47.140896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:47.144196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 320/624] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:47.149948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.156109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.157651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255850c-8eb2-4011-b909-d46702945564 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.187358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.224311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.278906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad476-c1ff-43ca-8a5d-f0a91a95ca87 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.366897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 305/625] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:47.368738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd047-75aa-44aa-adc1-cfbe863ff29c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.369255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd047-75aa-44aa-adc1-cfbe863ff29c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.369740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd047-75aa-44aa-adc1-cfbe863ff29c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.371698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 306/626] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:47.381047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fd047-75aa-44aa-adc1-cfbe863ff29c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.498002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fd047-75aa-44aa-adc1-cfbe863ff29c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.532717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.533350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.533627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.533896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.534771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:47.535085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.536757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e05aa-3e72-4dde-babc-027af9900224 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.537034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.538078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.538554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.538998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.545840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.552334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 321/627] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:47.554005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3003d2-5a47-4d28-af49-9e33a96b2353 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.554447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3003d2-5a47-4d28-af49-9e33a96b2353 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.554718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3003d2-5a47-4d28-af49-9e33a96b2353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.558714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.560297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.581497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0d3003d2-5a47-4d28-af49-9e33a96b2353 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:47.582710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0d3003d2-5a47-4d28-af49-9e33a96b2353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:47.590623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:47.591703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:47.592583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:47.592583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:47.592583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:47.592583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:47.593756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 307/628] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:47.594188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.657776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 322/629] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:47.659278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62c93-bc50-4646-a3b2-05dbf606a1b0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.659867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62c93-bc50-4646-a3b2-05dbf606a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.659867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62c93-bc50-4646-a3b2-05dbf606a1b0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.661369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 323/630] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:47.662075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62c93-bc50-4646-a3b2-05dbf606a1b0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.690028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.705243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4dc-52f0-4357-9345-56198be36dce None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.740670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.741471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.741754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.742028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.749032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.750495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-36eeca11-6125-4a3f-ac24-0ca1667e94b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:47.764671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:47.765739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:47.766787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 308/631] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:47.767437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040782-d888-4416-bcf4-76b7154a1086 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.767437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040782-d888-4416-bcf4-76b7154a1086 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.767613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040782-d888-4416-bcf4-76b7154a1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.773170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62c93-bc50-4646-a3b2-05dbf606a1b0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.785531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e040782-d888-4416-bcf4-76b7154a1086 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:47.786846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e040782-d888-4416-bcf4-76b7154a1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:47.809070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.809751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.810030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.810300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.811028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:47.811335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.812759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.823947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 324/632] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:47.824727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.830707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.855046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 309/633] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:47.856377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007769-7ad1-4fba-85fe-11bd4bdd14eb None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.856646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007769-7ad1-4fba-85fe-11bd4bdd14eb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.856924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007769-7ad1-4fba-85fe-11bd4bdd14eb None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.858686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 310/634] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:47.859203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007769-7ad1-4fba-85fe-11bd4bdd14eb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.912934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.929594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2114e46-1881-43ee-a008-37f193d6f842 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.961548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007769-7ad1-4fba-85fe-11bd4bdd14eb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.962333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.963126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.963400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.963700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.978120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:47.986141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:47.987321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 325/635] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:47.988215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.000767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.001440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.001723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.001996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.002804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.003109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.004602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d0a5c-fc1a-4446-94ea-44151581c7cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.016668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 311/636] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.017871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.018162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.018556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.035191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:48.036470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:48.063732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.091152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f625d9-ba6b-451a-a6d3-a63782af348b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.102486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 312/637] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:48.103603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.125680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.126479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.126969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.127090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.134314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.135835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:48.149815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.151142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 326/638] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.152053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.156756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.212806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9279-3d3f-49e5-8df5-24c35731515f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.246614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.247413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.247725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.247986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.251239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebd2-b73e-4e4b-bc76-cace8379829f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.258602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:48.266280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.267333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:48.268196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 313/639] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.268868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.286660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.287256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.287531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.287826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.288575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.288873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.290248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.296135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.303011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 327/640] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.303011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.363724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.372601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b128-355f-4877-8f76-909133c0c3b8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.399463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580ef65-6676-4904-8a0d-bc49a2be3245 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.406342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.407233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.407509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.407821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/6fbd6a83714a4d88ae001e7ed462fa86/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.421797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=6fbd6a83714a4d88ae001e7ed462fa86, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.423235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.434315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.435110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.435386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.435703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.436216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 314/641] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:24:48 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/6fbd6a83714a4d88ae001e7ed462fa86/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:48.441817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.457355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:48.465481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.466832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:48.467927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:48.469227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 328/642] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.472534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.541904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.567927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d150-1c77-490e-8b59-97876f9e5c00 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.600308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791bd31-b17e-492c-8db6-211dc7818983 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.611755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.612648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.612936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.613203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.614008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.614313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.615785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.632960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 315/643] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.632960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.633259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.644978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.645663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.645943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.646216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.646962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.647269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.648742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.657487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 329/644] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.658305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.742577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621144a-0d5c-4ca0-99cb-44a1b86590e2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.765977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca42bd-58f3-4639-99bb-2fddba4196d4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.780243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.781049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.781327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.781595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.785583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.794665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.796106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.805518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.806191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.806468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.806735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.807482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.807974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.809395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:48.813840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.814677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 316/645] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.816735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.823746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 330/646] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.824811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.884074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.920829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8135-0b64-4b16-b5f0-92cf6f28058a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.942156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179d58-33f0-42c0-9498-98e2d73515e0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.954302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.954964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.955244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.955517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.956440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.956742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.959146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.965568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 317/647] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.965568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.992442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.993264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.994096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.994377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.010986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.012529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.035941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:49.037120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.037978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.038839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:49.038839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:49.038839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.038839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:49.039395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 331/648] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.039956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.092763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d362b46-6f59-4bb6-89d1-578f98015a5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.143724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.144414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.144947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.145231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.146401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.146711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.148175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.163670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163fb4f-cef5-4e8c-b2a1-b3327b516f53 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.165604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.168367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 318/649] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.170705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.207521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.208618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.209138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.209503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.221118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.222842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:49.244905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.245860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.246748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:49.246748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:49.246748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.246748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:49.246748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 332/650] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.247586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.295050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a9bb-4ad2-4e75-92eb-870b7c63134d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.314683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.340216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.340892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.341170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.341442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.342175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.342476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.343933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.358759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 319/651] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.363559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.377979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1253-359c-47cb-b310-e3a9e88fe04d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.413314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.413802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.414078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.414348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.422420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.424193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:49.438388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.439560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 333/652] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.440717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.467959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.488888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4d8e-9fb2-4fd8-9cbc-6a84002f1ced None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.532122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.533069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.533543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.534408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.535699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.536418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.538390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.558297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf0ad-3b4d-4c7b-914d-8f234eeccfd7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.558727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 320/653] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.560397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.598263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.601535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.602056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.602431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.603897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.613195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.614880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:49.633901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.635051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:49.636216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:49.639675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 334/654] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.640632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.689723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4362a-bcc8-45d4-9a30-bee9677f1af7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.722936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.727004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.728298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.728827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.729107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.729965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.730274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.731890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.747570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacfa75-de51-4c8c-b997-908c29623052 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.755901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 321/655] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.757071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.784567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.785694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.786095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.786513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.794815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.796306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:49.810645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.811671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 335/656] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.812632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.886156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.895057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ceef9-4fd6-4ab4-9338-e245451326bf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.924970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e15a4e-3320-4663-9fcc-467641d7e698 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.939447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.940474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.940763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.941036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.942361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.942823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.944680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.966468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.967329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.967746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.968167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.971724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 322/657] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.972615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.973790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.044259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.045885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.103241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff0c2-5368-4649-962c-e31c1957f260 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.142177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.143230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.143829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.144282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.145295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.145794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.147413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.153501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 336/658] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:50.154612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.171510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 323/659] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.172720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.181634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.193235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.268222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb68f2-5c8e-45c0-8a9b-4e3352c3c538 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.278376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18094a4-ea3f-4c94-adfa-33a76f7ba497 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.306559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.307634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.308139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.308550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.315836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.316762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.317137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.317503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.328188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.329782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:50.348352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.349494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.350568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:50.350568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:50.350568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:50.350568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:50.351927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 324/660] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.352854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.388273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.390025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.413516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.426886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.455179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7fb88-f055-44b7-8543-f0319a84a238 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.490675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.491370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.491782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.492164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.502502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 337/661] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:50.503936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.565915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.567723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.614473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29b5-4ce2-443f-826d-2b290b32bdb8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.637655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.652153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.653043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.653494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.653907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.654770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.655224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.656898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.658857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.671174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 338/662] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.672450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.684837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 325/663] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:50.685762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.779276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8013ba-d4b5-437b-80c9-528acacf7e85 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.792298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619938c-d913-429a-b174-bbf5c4e0df60 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.816323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.817384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.817844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.818334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.826230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.827041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.827295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.827585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.829769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.831946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.834480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.835949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:50.849450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.850342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:50.851215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 326/664] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.851724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-737e6419-1629-4659-ae67-bedf9481d477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:50.857521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.860445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 339/665] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa44dc-b104-4cd0-894f-59e3bee0860d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa44dc-b104-4cd0-894f-59e3bee0860d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa44dc-b104-4cd0-894f-59e3bee0860d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.863157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 340/666] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:50.864320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa44dc-b104-4cd0-894f-59e3bee0860d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.876922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.913937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.966561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86640cf8-cec6-4fa2-bbf4-cb2021168c7e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.968481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa44dc-b104-4cd0-894f-59e3bee0860d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.002865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041464a-54cc-4940-9417-602752867660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.003990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041464a-54cc-4940-9417-602752867660 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.004268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041464a-54cc-4940-9417-602752867660 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.004541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041464a-54cc-4940-9417-602752867660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.006155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.006908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.007367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.007484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.008284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.008623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.010049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.015859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041464a-54cc-4940-9417-602752867660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.017299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041464a-54cc-4940-9417-602752867660 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.022619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 341/667] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.023277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4041464a-54cc-4940-9417-602752867660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:51.040399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.041332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.042183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:51.042183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:51.042183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:51.042183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:51.046297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 327/668] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.047401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.047723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.047986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.064517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:51.065925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:51.134426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.137627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234f79-13b5-4008-95db-3d9dd9ff6ac3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.143722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 328/669] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:51.145067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.153061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.182261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.182924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.183199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.183469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.184219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.184524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.185912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.197569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 342/670] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.200727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.262515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55965be-d6be-4032-90cc-3fef31b907e9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.297177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.297984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.298361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.298631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.299557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=0b164dd7ea5b474d85d541ad7815f1ac) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.299861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.301339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.303759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664700-87f8-4b2d-8194-9801848a77a0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.307459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 329/671] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/role_assignments?user.id=0b164dd7ea5b474d85d541ad7815f1ac&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.308145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.349667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.350348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.350626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.350898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.351669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.351973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.353423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.371177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 343/672] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.371177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.387670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.400412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.435183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2993b-8bd7-4b2e-b5e4-7d7f82100104 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.475815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.476908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.477185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.477453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.481833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1353e-fec7-407e-b049-0671886a831f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.489719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-26cc7b54-8388-4ee7-a7cf-d03dcf07c5b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:51.498165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.499247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:51.501782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:51.503688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 330/673] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.505282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5b0-83c8-49ae-9426-1ae25d172a6c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.505670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5b0-83c8-49ae-9426-1ae25d172a6c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.505950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5b0-83c8-49ae-9426-1ae25d172a6c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.507421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 331/674] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:51.507992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f5b0-83c8-49ae-9426-1ae25d172a6c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.530312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.531361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.531906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.532317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.541453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.542923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:51.556919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.557915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 344/675] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.558977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.633165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f5b0-83c8-49ae-9426-1ae25d172a6c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.650877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.661432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.667779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00418-0b03-448c-9e37-d6ed5c055e8b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.673576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.674486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.674766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.675039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.682034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.683489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9665a8e3-f797-48e9-802c-7cf036d584f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:51.698351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:51.700407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 332/676] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.701240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.701517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.701784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.708385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.708830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.709107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.709375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.710128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.710427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.711830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.719044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:51.720258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:51.725590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 345/677] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.725590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.797381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 333/678] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:51.798398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.846059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e408a-d12c-4613-acbe-be79dca1441c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.882437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.883099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.883377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.883680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.884467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.884767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.886214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.898303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 346/679] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.899081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.908489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402261-d5d9-4171-80d2-1de9fe460157 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.911068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.925522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.947003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.947730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.948016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.948293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.949091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.949401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.950836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.962742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 334/680] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.963387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.009267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a39da-fe0e-4a0a-8368-1c88530791d3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.043723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.044443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.044718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.044990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.056055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.057920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.069746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e93aa-cf2b-4539-b99e-68c330a521dc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:52.078018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:52.078966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 347/681] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:52.085496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.104208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.105120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.105494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.105782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.118369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:52.126383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:52.127328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:52.128888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 335/682] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:52.129584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.152447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.165537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.198725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64cc0-e57d-4566-8c6f-e161b86a105e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.234213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bcd3-9f37-46f8-80f2-f2ae9072bb09 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.234864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.235521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.235831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.236120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.237046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=7df29f2915c446f5b3c0ed3cfb14a89a) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.237354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.238834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.244897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 348/683] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/role_assignments?user.id=7df29f2915c446f5b3c0ed3cfb14a89a&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.256574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.282379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.284461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.284937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.285682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.287096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=33e60332dbea4c4e9e6884f5effd0d09) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.287631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.289757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.308205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 336/684] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/role_assignments?user.id=33e60332dbea4c4e9e6884f5effd0d09&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.308205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.462574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.466714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1a04-52c1-4a0a-846e-2a60a41b87f3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.497771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a93e8-9d4d-4953-8491-283272ae9079 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.509192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.509876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.510157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.510432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.511199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.511503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.512978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.523083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 337/685] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.529430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.545858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.561666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.562264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.562549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.562826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.563773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.564115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.566049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.581079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 349/686] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.586519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.663029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d3ff-347d-43d3-aa52-b1e56aee7012 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.701883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.703841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.704191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.704572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.716745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.718414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.723755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec022e-6793-45a9-bc76-04e204f6932e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:52.737897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:52.738829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:52.739898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:52.739898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:52.739898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:52.739898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:52.739898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 338/687] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:52.744644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.767562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.769449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.770474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.770750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.771027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.788877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.790380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:52.820622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:52.821654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:52.822584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:52.827998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 350/688] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:52.833746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.854540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca5dc-faad-4937-a473-20b06e7bd9a5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.890684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.891374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.891707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.891986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.892943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.893280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.894669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.907527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 339/689] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.913441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.925826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.993466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.019936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42591-47b2-4721-851b-98d5c0a74044 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.043338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9a32-c5e3-4f1a-92b4-f0b94c3233e4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.056303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.057110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.057390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.057664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.066027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.067582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:53.083672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:53.084826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:53.085982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:53.086898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 340/690] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:53.092528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.107064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.108416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.108981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.109427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.110444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.110924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.114679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.145113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 351/691] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.150715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.238840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df599a9f-566b-4817-90e8-3070d51a539b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.274418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.275200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.275484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.275804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.276647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.277048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.278680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.297260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 341/692] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.300040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.307638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.332425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a861-fb20-41fc-91ec-7bfeba9371e0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.341453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.369208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.369859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.370135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.370404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.438455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.440112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.517736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8cd9-5c0a-4c2e-81bc-d0f86599cb8f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.544477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 352/693] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:53.552573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.555564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.579327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.580173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.580917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.581203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.686540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.704801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.706752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a113a5a-4d8f-4c77-9ea6-7e44c9b7749f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.719053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f92fbf-8288-463d-abb1-b3ad0aec6bdd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.760165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.761480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.761770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.762047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.789011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.789974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-79340d20-8894-46e0-aa6c-136ac154b8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:53.810110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:53.811061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:53.812024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:53.812024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:53.812024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:53.812024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:53.814132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 353/694] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:53.815847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefef6-aac4-4437-8dfa-b45882c8e1f8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.816341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefef6-aac4-4437-8dfa-b45882c8e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.816804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefef6-aac4-4437-8dfa-b45882c8e1f8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.822479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 354/695] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:53.822875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 342/696] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:53.823980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefef6-aac4-4437-8dfa-b45882c8e1f8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.825342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.825730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.826103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.843844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:53.845355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:53.882992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.927379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 343/697] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:53.928605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.954227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefef6-aac4-4437-8dfa-b45882c8e1f8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.970994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.994890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.995761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.996151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.996660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.998031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.998440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.000420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.019850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 355/698] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.021022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.077834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c7e38-9623-4586-8af6-904ec2980ded None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.119994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.121019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.121444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.121881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.132699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.132827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780098d-14da-453e-bb7b-3453cb6a8cc7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.134518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.148966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:54.153217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.154099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.155000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:54.155000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:54.155000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.155000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:54.157464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 344/699] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.159292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.182394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.183629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.184151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.184716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.197825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.199675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:54.219329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.220273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.221390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:54.221390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:54.221390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.221390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:54.224074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 356/700] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.225074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.231903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.265413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9f70-d069-43ae-8d66-459b51d7971e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.304588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.305399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.305682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.305954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.314784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.316395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:54.335838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.336883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:54.337762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:54.339620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 345/701] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.340632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.349765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a825de-1df2-46a2-a6a4-8387cf2f9333 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.394435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.395530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.396438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.396933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.398504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.399011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.401346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.418307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 357/702] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.421752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.453186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.465097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d61d2-c252-475d-b625-58136caedeff None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.497209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.503162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.504360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.504872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.505359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.506288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.506801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.508688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.522453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 346/703] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.524250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.542258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9052ed-18c2-4418-a4d7-607825bf1219 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.579712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.580563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.580838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.581202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.582027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.582335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.584189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.602517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 358/704] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.603475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.634586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce742b9-45c7-4f4e-977c-f5478cb2b82d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.671438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.672636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.673154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.673718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.681408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.683135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.694868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:54.699179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.700082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:54.700964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:54.703283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 347/705] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.704467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.717109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669526d-4fbb-4ce2-8404-a4777fc34a47 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.753940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.754539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.754928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.755282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.756113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.757788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.766522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.799906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 359/706] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:24:54 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:54.801257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.850409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2158d9-2592-467f-9e1a-436aae590364 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.924069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.925223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.925998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.926469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.928765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=6fbd6a83714a4d88ae001e7ed462fa86) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.929473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.932740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8edb7-b993-4a44-968f-4d06206f62f3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.947700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 348/707] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/role_assignments?user.id=6fbd6a83714a4d88ae001e7ed462fa86&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.965669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5633b-12d8-4f51-85b0-f94c87079150 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.966297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5633b-12d8-4f51-85b0-f94c87079150 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.966764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5633b-12d8-4f51-85b0-f94c87079150 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.968820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 349/708] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:54.976174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef020-8e0e-49eb-8716-7b9c139189cb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.976827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef020-8e0e-49eb-8716-7b9c139189cb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.977307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef020-8e0e-49eb-8716-7b9c139189cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.007424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-645ef020-8e0e-49eb-8716-7b9c139189cb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:55.010012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-645ef020-8e0e-49eb-8716-7b9c139189cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:55.032591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4747c-2b73-4726-89ca-7a1428e39a10 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.081301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.082490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.082985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.083462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.085339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.086212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.088817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.102835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 350/709] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:55.104282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861950-e7a1-42cc-8348-43a2fb979a06 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.104563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861950-e7a1-42cc-8348-43a2fb979a06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.104836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861950-e7a1-42cc-8348-43a2fb979a06 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.106089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 360/710] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.112411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 351/711] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:55.112952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.123597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.123597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.123597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.124332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.142227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:55.145033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:55.201705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.233129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 352/712] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:55.234131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.257698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0183-a98e-435a-88eb-a91011cba681 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.300213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.301570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.302010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.302287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.303123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.303429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.304967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.311289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 361/713] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.312142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.348909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e452721-93fb-43eb-a78a-8e2ffd5e28c4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.410503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.414183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.415076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.415356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.415659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.416335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.418041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:55.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:55.442631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:55.443578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 353/714] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:55.453773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.489723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e216c-3e87-46a2-85c0-5f42d6e05f1b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.543603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.548747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.549767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.550051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.550320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.550992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.553423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:55.576632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:55.577626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:55.578438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 362/715] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:55.585762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.667645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d58b-9250-4710-a93c-f4844f51e3f7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.722163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af597-4b03-4e21-b564-1a79ddd33dc7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.757761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.758444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.758721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.758994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.759773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.760077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.761539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.766753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 354/716] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.767155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.775696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.792270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.792970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.793250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.793525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.794443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.794984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.796127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.805310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 363/717] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.810806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.911210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504094-9612-4121-851a-4bc825454cf0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.924687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.939964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794be9-6863-4532-81db-ddc841f380c9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.976801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.977469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.977745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.978014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.978726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.979026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.980548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95719416-65ce-4be9-981a-35184aa6ced4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.984820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.985497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.985777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.986048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.986985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 364/718] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:55.987106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.987348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.988817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45915ea-9024-4b15-bbbe-7b4ca22cbbf2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.995581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 355/719] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:57.498471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84811e2-ead4-413e-93e4-7ea2f52ed882 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.499054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84811e2-ead4-413e-93e4-7ea2f52ed882 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.499054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84811e2-ead4-413e-93e4-7ea2f52ed882 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.500804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 365/720] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:57.507117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bb0-8690-41bc-b8e3-9775cd6974fc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.507677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bb0-8690-41bc-b8e3-9775cd6974fc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.507677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bb0-8690-41bc-b8e3-9775cd6974fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.531778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-28d70bb0-8690-41bc-b8e3-9775cd6974fc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:57.533056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-28d70bb0-8690-41bc-b8e3-9775cd6974fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:57.642239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 356/721] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:57.684294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84811e2-ead4-413e-93e4-7ea2f52ed882 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.756853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:57.825213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84811e2-ead4-413e-93e4-7ea2f52ed882 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.861831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2ae-3ea5-4af9-8a90-5272f4e6978c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.862172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2ae-3ea5-4af9-8a90-5272f4e6978c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.862459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2ae-3ea5-4af9-8a90-5272f4e6978c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.864132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 357/722] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:57.873004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27baab-21ab-4d43-86ff-91ab86613167 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.873329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27baab-21ab-4d43-86ff-91ab86613167 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.873575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27baab-21ab-4d43-86ff-91ab86613167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.876548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.878075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.878631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.879103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.890819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:57.899049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:57.900069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:57.900901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:57.907738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 366/723] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:57.909899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.920532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ee27baab-21ab-4d43-86ff-91ab86613167 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:57.921750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee27baab-21ab-4d43-86ff-91ab86613167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.019978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329fd10-cb0f-4f97-9964-1bd32249cf59 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.039771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.062161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.063284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.063629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 358/724] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:58.064076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.064618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.065578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cb9b-43bc-4df1-ab65-eb3dc4b4f62d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.065866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cb9b-43bc-4df1-ab65-eb3dc4b4f62d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.066088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.066187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cb9b-43bc-4df1-ab65-eb3dc4b4f62d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.066684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.067705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 359/725] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.068572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.075749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.076035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.076309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.087727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 367/726] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:58.089335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.113024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:58.115051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.148111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.203276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87edcb-8281-402b-9880-1f65ad3ee2ee None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.209753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 360/727] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:58.211530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.246507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.248024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.248897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.249617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.264469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.266973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:58.286679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.287687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.288607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:58.288607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:58.288607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:58.288607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:58.295318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 368/728] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.296407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.321196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6fbc-1212-4ecf-9eb5-67465b645ff1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.331863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.358723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.359741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.360090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.360429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.372187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:58.379883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.380860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:58.382014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:58.386159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 361/729] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.387125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.407899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.414175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530e-1eed-4b7d-a6ed-d6fef1dbb562 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.450847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.452039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.452487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.452957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.465109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:58.474206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.475151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:58.476007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:58.478902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 369/730] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.480012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.505216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd062-3bdb-4c2b-b206-71a2a2355464 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.552242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.552888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.553209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.553570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.554399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.554763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.556350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.573590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 362/731] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:58.573590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.603034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc653d-9ff8-44a4-8849-025dc3f6825d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.623813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.644967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.645978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.646439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.646915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.648052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.648638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.650270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.657784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.662044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 370/732] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:58.663256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.686433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f581-aaf9-44be-9355-64b0d5315349 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.723154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.723907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.724191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.724474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.725226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.725721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.727104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.736052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 363/733] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:58.739691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.774242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0661a4f-3c26-4ca0-9bca-a552a491255e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.815938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.816682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.816965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.817240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.825731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.827199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-46ceb470-446e-49ce-ad30-f4bb6ffc797b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:58.842042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.843030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:58.844243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:58.847264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d94f-e94f-45f1-9271-c88ec98990eb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.848217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 371/734] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.849444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca284-d433-4ea4-b27c-f39efe821c8e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.849733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca284-d433-4ea4-b27c-f39efe821c8e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.850004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca284-d433-4ea4-b27c-f39efe821c8e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.851295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 372/735] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.852059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca284-d433-4ea4-b27c-f39efe821c8e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.870605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.882482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.883300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.883612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.883883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.892810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.895074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.896881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-35c5c31b-6a5f-4ae1-b622-064e63acc620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:58.913877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.914913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.915861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:58.915861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:58.915861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:58.915861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:58.915861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 364/736] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.916306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3005-f6ff-4d9f-865b-626a7aa6fb16 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.916591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3005-f6ff-4d9f-865b-626a7aa6fb16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.916868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3005-f6ff-4d9f-865b-626a7aa6fb16 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.922218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 365/737] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.922218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a3005-f6ff-4d9f-865b-626a7aa6fb16 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.966952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca284-d433-4ea4-b27c-f39efe821c8e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.003977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.004765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.005042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.005312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.015369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.016865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.022723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a3005-f6ff-4d9f-865b-626a7aa6fb16 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-51650233-1713-426c-b9e3-bdb2d19c37be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:59.035210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.036156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.037029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:59.037029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:59.037029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.037029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:59.037029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 373/738] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.037703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b62f-22f3-4bf2-84c1-735fea0185f3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.037994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b62f-22f3-4bf2-84c1-735fea0185f3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.038276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b62f-22f3-4bf2-84c1-735fea0185f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.055292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5b01b62f-22f3-4bf2-84c1-735fea0185f3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.056571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5b01b62f-22f3-4bf2-84c1-735fea0185f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.061946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.062618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.062898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.063172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.064063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.064418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.066004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.084166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 366/739] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.085172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.119164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.128238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 374/740] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:59.129694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.129981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.130260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.143936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.152974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.154224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.194329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f64a-d7f6-4c00-b8c3-c27f2f96c535 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.219846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 375/741] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:59.220765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.229815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.230519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.230898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.231169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.232292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.232590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.233964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.250942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 367/742] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.250942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.340998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ffc96-56f2-4578-aebb-5123bea4a56d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.357503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c43f-cc3f-4c81-ae7e-a8b37c45d225 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.366698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.367726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.380933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.381602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.382102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.382217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.382832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.383189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.384664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.393470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.393950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.394318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.394655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.396760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 376/743] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.397569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.467179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.468730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.498977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72627-ad54-41f8-bf07-0d754bce02aa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.535464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.536295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.536571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.536845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.537580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.539030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.559652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 377/744] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:59.559652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.577369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 368/745] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:59.578514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.593287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.626319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.695162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3182-3077-4809-a13d-560e157ca157 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.695887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c784-003b-4b64-a146-d7cd0903155e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.734726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.735151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.735849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.735963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.736442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.736582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.736827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.736917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.737590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.739004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.745765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.747373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.755417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 378/746] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:59.756841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:59.770627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.771708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:59.772863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:59.775473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 369/747] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.776688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.871627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.906491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541a6e-4696-4078-87ed-e3483b13244d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.909399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.917071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffab0a-6de4-49e8-b4a2-d5b223353f67 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.945150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.945977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.946245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.946518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.959743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.961230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.962134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.963253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.963555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.964893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.974833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.976414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:59.981499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.982736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.983736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:59.983736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:59.983736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.983736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:24:59.987652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 370/748] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.988572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:59.995396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.996573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:24:59.997698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 379/749] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.998411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.122553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd733-7578-4d02-9f07-d430e7ed90d2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.136574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daa088-dcc7-4144-ba83-ff41a7227424 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.161324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.162270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.162721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.163151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.164107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.164622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.166250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.180785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 380/750] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.182048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.205214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.303121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dc371-ceb5-4083-9619-e8f848d0f340 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.336795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.340190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.341107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.341609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.342127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.343312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.343846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.346592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.351022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.351738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.352020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.352291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.353139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.353444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.354890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.377127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 381/752] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.378382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.379807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 371/752] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.380739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.467922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.490565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39e7c-7b6a-4f8c-8e67-a5a9bf0342f8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.497349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa933c-b9ee-488c-bf91-1fbdf7fc5fae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.536392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.538094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.538904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.539917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.540181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.540283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.540750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.541218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.548032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.550162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.553270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.554959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:00.566511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:00.567395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:00.568309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:00.571977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 382/753] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:00.572802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:00.576576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:00.577435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:00.578739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:00.578739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:00.578739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:00.578739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:00.585500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 372/754] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:00.586670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.623959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.691102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d2c4-86b1-4c09-9870-07c0e3a135c3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.713751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d736bc-9a4f-4405-8802-0bfcc81e12c4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.728648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.729593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.730117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.730700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.735055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.753583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.754645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.755124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.755626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.756610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.757245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.758946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.771946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 373/755] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.773157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.822303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.824370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.881427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.890506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95e67-d8fe-41c4-ad6c-3ff75f90907a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.926610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.927528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.927998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.928412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.929294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.929739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.931376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.931499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 383/756] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:00.932258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.946948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 374/757] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.948283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.969413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.034667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50aaa-10a7-4c19-a0ba-0ebd5c712d11 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.054443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45b670-8e25-4797-9492-52c028161054 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.069776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.070435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.070710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.070982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.071844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=3770d9f2375a4c9aa2b5b514d1be39c5) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.072150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.073705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.079996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 384/758] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/role_assignments?user.id=3770d9f2375a4c9aa2b5b514d1be39c5&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.081545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.103368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.104444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.104867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.105277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.128981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.130701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:01.166059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:01.167150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:01.168052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:01.168052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:01.168052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:01.168052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:01.170926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 375/759] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:01.175849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.180130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.187989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.195020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e8834-df46-4736-bc69-8d655ff7d4b8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.234986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.236415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.236919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.237385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.245895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.247749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:01.263650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:01.264599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.265466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:01.268217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 385/760] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:01.274197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.360468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b008774-9a43-49d5-8512-79a616342108 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.406990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.408132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.408623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.409120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.410115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.410610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.412515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.429176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 376/761] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.435593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.453507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6959-6aaa-4db1-9a7e-997b5c3a89a7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.515980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.523729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.524467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.524750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.525157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.526098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.526406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.529994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.555628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 386/762] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:01.562297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.590526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c90a3-37c6-4bb8-a0c9-2babd0824465 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.604597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.665914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.669601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.669884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.670158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.686574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.688536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:01.705038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:01.706174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.707911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:01.709359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 377/763] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:01.716087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.762501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b110f94-a896-4b4b-a2df-88b379fff44f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.828152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.829104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.829379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.829696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.833625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=29b77d3d3a1345f98194174676e35873, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.836695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.861687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 387/764] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:01 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:25:01.873521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8483-c563-47da-b98c-94a3c5895284 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.909505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.924275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.924967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.925243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.925514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.926320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.926619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.928255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678a90f-8505-4d60-a533-2ac3fceb3a26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.944244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 378/765] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:01.950158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.065305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.093419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb37d7-8433-4b67-af98-71186cfad0bb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.100297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb267-c72e-49db-870c-4a75d38039cc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.100611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb267-c72e-49db-870c-4a75d38039cc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.100821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb267-c72e-49db-870c-4a75d38039cc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.103440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 379/766] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:02.109262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.109543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.109807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.143278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.144018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.144294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.144565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.145418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=6fbd6a83714a4d88ae001e7ed462fa86) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.145720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.147208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577c18e-7703-4e16-a0c0-c96d3019318f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.147706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:02.149068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:02.157572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 388/767] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/role_assignments?user.id=6fbd6a83714a4d88ae001e7ed462fa86&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:02.185343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80eb4-a520-45e0-adda-971e14cd9ee7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.185343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80eb4-a520-45e0-adda-971e14cd9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.185638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80eb4-a520-45e0-adda-971e14cd9ee7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.187093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 389/768] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:02.193905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.194569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.195042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.215806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:02.217938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:02.290608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 380/769] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:02.314090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.318691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 390/770] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:02.344055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.435115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59131cd-b250-438c-9688-9a8be8681653 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.451060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.475793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.481162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.482191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.482472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.482742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.483399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.484856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.507582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd08e-27bc-4dc2-a412-a3a0d0e35ac0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:02.509640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:02.510549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:02.511379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 381/771] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:02.517182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.551101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.552267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.552753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.553202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.554037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.555668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:02.568953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:02.569965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:02.570821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:02.573719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 391/772] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:02.580828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.665361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52cd3-42d9-4222-a4db-8f2559490636 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.700967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.702000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.702457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.702905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.703861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.704452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.706270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.711679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 382/773] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:02.717302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.771665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84cf26-5270-4923-84ed-2bed642a81c0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.807348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.808143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.808503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.808828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.809611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] RBAC: Adding query filter params (name=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.809981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.811450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.816881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 392/774] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:02.817710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.822561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.827930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.920508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cee3bf-dcba-4986-bbf6-800b78ed170e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.974673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35d0f-0d5b-4e41-b767-4657ddd97b5c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.985242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.986189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.986542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.986820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.987708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.988027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.989414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.997750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 383/775] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.003089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.041930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.042651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.042936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.043211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.043948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] RBAC: Adding query filter params (type=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:03.044249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.045957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.057068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 393/776] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.060853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.167417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.190936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f9c09-4102-46ec-88e8-626bbdf20615 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.200794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.229616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8ea1-47f2-4ea4-9316-ed221daa8177 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.253936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.254607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.254886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.255157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.255994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] RBAC: Adding query filter params (interface=public, service_id=f78dcb553b334e97acb9f6c023e306d9, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:03.256304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.257684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.275682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 384/777] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/endpoints?service_id=f78dcb553b334e97acb9f6c023e306d9&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.280522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.293964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.294688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.294968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.295240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.296105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] RBAC: Adding query filter params (interface=public, service_id=eb113e66bcde4fc0853f7c9ac40ffea9, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:03.296416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.297814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.316932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 394/778] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/endpoints?service_id=eb113e66bcde4fc0853f7c9ac40ffea9&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.320477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.463350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbfad-63bb-4bbb-b86a-a087faf9c49d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.500239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f4b3-49d6-47ec-9030-7a680d45a567 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.521857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.522539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.522817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.523087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.523810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.525192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ca03-bcaa-46c0-9f69-f22ac46e55b4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.537497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 385/779] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.553659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.560800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.561693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.562116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.562402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.563146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.564730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344e202-73a4-4110-9336-b0c2a00a24fe None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.571767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 395/780] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.767664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa18a-5673-42fa-a921-3a787b99345e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.768219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa18a-5673-42fa-a921-3a787b99345e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.768219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa18a-5673-42fa-a921-3a787b99345e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.770076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 386/781] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:03.777396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.777927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.777927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.809272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:03.810482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:03.896947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 396/782] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:03.930775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfa18a-5673-42fa-a921-3a787b99345e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.974121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.055461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfa18a-5673-42fa-a921-3a787b99345e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.091035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.092160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.092653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.093066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.104000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:04.112561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:04.113731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:04.114772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:04.117303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 387/783] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:04.122863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.270552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d158d1-e206-40fc-b5bd-61e17caa3471 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.299041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.315665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.316260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.316535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.316807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.317559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:04.317861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.319242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.331006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 397/784] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:04.336799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.476855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.484261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8735-3f28-440d-85b9-a147985e3c90 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.533443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.534463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.534796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.535076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.548958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.550427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:04.573108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:04.574055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:04.574930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:04.574930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:04.574930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:04.574930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:04.579583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 388/785] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:04.580326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.739387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a455-2fbd-412b-8e92-93b077f14456 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.799104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.799863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.800146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.800420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.801197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:04.801499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.802943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bec1e-e634-4c69-b87c-528f3ad460fd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.820988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 398/786] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:04.827408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.832090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018a0c-ee82-447a-8411-0aee8533d232 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.832616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018a0c-ee82-447a-8411-0aee8533d232 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.833091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018a0c-ee82-447a-8411-0aee8533d232 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.834907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 399/787] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:04.840201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604cd-fe91-4505-ba48-5174b58b022f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.840755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604cd-fe91-4505-ba48-5174b58b022f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.841229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604cd-fe91-4505-ba48-5174b58b022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.858984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-241604cd-fe91-4505-ba48-5174b58b022f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:04.860744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-241604cd-fe91-4505-ba48-5174b58b022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:04.905207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.931947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 400/788] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:04.933630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7355-cf29-470c-907a-24efb8cb538b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.934116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7355-cf29-470c-907a-24efb8cb538b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.934588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7355-cf29-470c-907a-24efb8cb538b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.936303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 401/789] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:04.948960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.949242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.949515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.975909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:04.977457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:05.005617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb554-4ba6-4276-a2bd-b8a428ed2d03 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.048943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.049828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.050185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.050447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.058816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.060572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.066521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 402/790] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:05.067610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:05.092872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.093865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:05.094796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 389/791] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.099824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.110776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.184989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a84c7-6f0e-4f5d-bef2-61be0c5648d2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.194519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.207457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b925-4880-4b08-9710-7abe525e182a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.226051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.227153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.227644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.228093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.240657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:05.244194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.244972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.245349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.245716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.246670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.247074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.248723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:05.249745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.250831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:05.251746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:05.259136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 403/792] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.260361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.269151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 390/793] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:05.270561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.349299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.380809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989dae-4a6b-4483-8aef-2518f3a31997 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.395620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68ba6-25f8-4a2c-84e8-2567d1c46f5f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.427803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.429169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.429688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.430258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.430611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.431289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.431608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.432059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.432817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.433125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.434737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.444563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:05.448590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 391/794] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.449491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:05.454895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:05.456757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:05.464914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 404/795] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.464914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.502913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.560480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f0c8-d188-4b47-9c32-8461ae9c6a97 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.587241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.597304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf5fd-67d9-4288-8127-abfeb101ded5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.597915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.598879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.599474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.599982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.612907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.614721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:05.632845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.633788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.634662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:05.634662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:05.634662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.634662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:05.636496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.637207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 392/796] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.637371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.637944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.638372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.638486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.652367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.653858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:05.677387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.678341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.679236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:05.679236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:05.679236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.679236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:05.681994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 405/797] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.683076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.752803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720e70-6905-48d1-8d8a-18d042886291 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.782193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.802064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.803121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.803731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.804204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.805164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.805685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.807262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.808400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5d72-7504-4f62-97f7-32fd1ee827e4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.821886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 393/798] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.823072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.854555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.855190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.855473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.855768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.857060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.857362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.859388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.869073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.874842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 406/799] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.876065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.933604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002e2-2287-4baf-a1a9-bb17cc9a09bc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.973923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.974979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.975613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.976084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.977015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.977516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.979103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.998143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 394/800] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.999400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.004430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010df6-33da-462d-b304-8edcb49f13e7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.042326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.043660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.044215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.044683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.054327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.057678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.059657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:06.080820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.081770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.082656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:06.082656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:06.082656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:06.082656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:06.089655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 407/801] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.091028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.121052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.125549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99989070-80fd-4327-8ac2-1638bd3d051f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.165250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.166048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.166329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.166606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.173695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.175144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:06.189916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.190857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:06.191769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 395/802] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.192871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.211454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7151-cb08-4f82-ba00-4aeae9e32205 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.249990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.250791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.251125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.251428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.259759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.261330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-8ecb03db-f3c7-40d5-947e-52deed9c5297 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:06.275936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.276906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 408/803] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6434fb-2160-4584-bcac-f428358aebde None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.283355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6434fb-2160-4584-bcac-f428358aebde None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.284249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6434fb-2160-4584-bcac-f428358aebde None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.284828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 409/804] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:06.285618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6434fb-2160-4584-bcac-f428358aebde None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.310495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb503d-18e3-4f2c-b821-37a2d6942c77 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.335397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.342994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.343682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.343964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.344272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.345085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.345641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.346725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.358581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 396/805] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.359364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.381588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.386559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6434fb-2160-4584-bcac-f428358aebde None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.419467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.420162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.420436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.420703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.421477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.421771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.423278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb75c6-3309-4962-bc81-d333fcd44a82 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.434528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 410/806] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.435746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.436027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.436299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.452947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:06.454158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:06.459357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52063c8-ff10-494e-8bdf-e3a1592f23f6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.493725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.494387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.494665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.494934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.495820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.496121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.497548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464af8-4f1a-45a7-906c-c00a3d8dba4d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.514695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 397/807] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.516002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b83f5-1900-4feb-a918-89eaca2e3b79 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.516285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b83f5-1900-4feb-a918-89eaca2e3b79 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.516558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b83f5-1900-4feb-a918-89eaca2e3b79 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.518057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 398/808] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:06.518748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b83f5-1900-4feb-a918-89eaca2e3b79 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.527340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 411/809] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:06.528245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.570365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.600628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.623069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b83f5-1900-4feb-a918-89eaca2e3b79 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.626386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d7e2-2cbe-45c3-8305-807b4ec161fd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.657279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.657982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.658262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.658533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.659902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.660802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.661085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.661353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/3770d9f2375a4c9aa2b5b514d1be39c5/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.665501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.666951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.676028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=3770d9f2375a4c9aa2b5b514d1be39c5, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.677475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eea6e6-73ab-406b-b19e-c9f2817ffd4c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:06.681255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.682715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 399/810] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.683666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.696643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 412/811] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:06 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/3770d9f2375a4c9aa2b5b514d1be39c5/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:06.697961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.698251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.698526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.716113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:06.717354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:06.803319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 413/812] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:06.804244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.826490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.831604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe82e6-4cbe-483d-af70-618da3e90983 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.869060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.869728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.870330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.870330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.879641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.919161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050d8b-4df1-45e6-8990-ca668824ab6b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.948346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.949797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.958004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.958885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.959253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.959620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] PATH_INFO: `/v3/services/network` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.960381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.961931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.975674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:06.982058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 414/813] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.982898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.064689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 400/814] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:07.064689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.070433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.088141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4e76d-8a89-46ff-b00c-9cc625a65531 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.104901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.124272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.124940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.125218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.125492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.126613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.126913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.128393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.150752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 415/815] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.150752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.174668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0479a-09dc-4350-9cb3-c073e9fc6bd0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.214453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.215270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.215573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.215851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.216514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.217895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.230445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.231868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:07.232746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 401/816] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.233586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.261007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb6e7-7b8c-42ad-9254-91c5d9f66e98 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.296145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.296811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.297093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.297397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.298847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] RBAC: Adding query filter params (name=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.299164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.300579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.309588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 416/817] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.309588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.317113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.343518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90195-bc26-4979-aa2f-240e7f0fc8b2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.345253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.381596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.382381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.382660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.382929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.393547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.394994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:07.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.412787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.413693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:07.413693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:07.413693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:07.413693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:07.413693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 402/818] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.413967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.424906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a80ae-4d31-4cdf-874e-b5fb1b83fe04 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.462766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.463849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.464336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.464883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.476967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.478446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:07.497754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.498938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 417/819] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.499906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.523876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dece0-3357-4f8a-b79d-02d741183e3f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.558232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.558904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.559183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.559467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.560197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.560498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.561875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.566673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.567616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 403/820] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.568466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.590584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.619933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59052-ffed-4c51-8c5d-3beeec072da1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.655816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.656732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.657313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.657910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.658885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.659356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.660990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.671428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 418/821] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.672434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.673276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e637-3303-44cf-91ee-dfb12ee94cfb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.708288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.708971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.709235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.709491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.710219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.710518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.711961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.724474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 404/822] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.725288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.789585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c739-5d47-46b9-83e9-8c19f5c98bb9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.814131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.815663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.828788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.829659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.829935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.830207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.830937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.831238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.832651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.840212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f540-258c-44b0-a580-b621f7289bce None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.845073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 419/823] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.845900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.885768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.886844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.887124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.887396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.888500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.888806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.890501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.896361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 405/824] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.897174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.952445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c15f-07f3-4d01-b97c-bb5eda4c4ca1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.985730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.986312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.986678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.986956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.987728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.989146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.004715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7363-c6ed-4bb6-bb12-bbecda69f40c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.012735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 420/825] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:08.013590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.065563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.086520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.087351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.087668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.087956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.100376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.101873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.104191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:08.121243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:08.122216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:08.123090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 406/826] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:08.123593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.159346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33c61-cae0-411c-80d6-b29b84d95144 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.209320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.211690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.211690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.211690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.221192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.222670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.236762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c06580-b6ca-46b8-915e-c2a25c2e4dee None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:08.240686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:08.241592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 421/827] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:08.242475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.285391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.286184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.286357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.286600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.287339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.288747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.319585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 407/828] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:08.319585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.380262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.385348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeccfb-3d2e-4fcb-abad-c98b8b43c556 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.400574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.437631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.438772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.439246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.439845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.440990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:08.441514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.443307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.458230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 422/829] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:08.464765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.467793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda7a38-74c0-4044-8742-dedf44ae72b0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.510582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.511565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.511918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.512188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.513040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:08.513349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.514806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.531475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 408/830] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:08.538157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.611329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadfcb-df78-4329-884a-701342b2d576 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.659121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8246-a110-47f4-807c-3a0df59bf18b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.660163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.660913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.661267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.661878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.663800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:08.664185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.665721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf64b9-e623-4c55-bd61-fcd7f985fcbb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.679570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 423/831] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:08.679774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.701763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.702698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.702980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.703257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/6fbd6a83714a4d88ae001e7ed462fa86/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.705550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=6fbd6a83714a4d88ae001e7ed462fa86, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.707077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31268d5-ecf5-4222-9319-7029565ffc50 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.726660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 409/832] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:08 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/6fbd6a83714a4d88ae001e7ed462fa86/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:08.921694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935c0b-39a6-4dc6-9636-686dadfeb584 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.922250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935c0b-39a6-4dc6-9636-686dadfeb584 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.922250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935c0b-39a6-4dc6-9636-686dadfeb584 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.924341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 424/833] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:08.930321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.930836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.930912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.949519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:08.950712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:09.027653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 410/834] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:09.046416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935c0b-39a6-4dc6-9636-686dadfeb584 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.068721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.155561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935c0b-39a6-4dc6-9636-686dadfeb584 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.191488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.192349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.192629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.192900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.203505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:09.211267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.212221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:09.213052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 425/835] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.218592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.321341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8802-376e-47a7-bcf1-ff44a40e65a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.323601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.356321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.356995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.357277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.357552 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.358308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.358609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.360021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.373017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 411/836] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.374441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.459179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.482830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d45c-ea84-4ddb-9e5a-04cc24ae526b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.520600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.521779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.522247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.522812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.535131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.536932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:09.558328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.559283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.560232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:09.560232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:09.560232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:09.560232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:09.562506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 426/837] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.568340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.677083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ced98-634b-4c11-af56-7e5f7e7bcdc0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.710559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.711272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.711573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.711899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.712631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.712931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.714310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.726320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 412/838] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.732056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.838823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fe255-089e-432d-a128-dbbaa3a139f9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.867357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.873110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.873929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.874205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.874478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.882841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.884333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:09.898786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.899782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:09.900740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 427/839] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.906374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.937028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.016832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846496c-5282-4c0c-bcad-9708ad2b45a1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.052686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.053363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.053653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.053910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.054760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:10.055061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.056539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.074890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 413/840] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:10.080930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.184808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c86-c63f-4736-89b7-acc61e4b605d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.218516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.219165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.219464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.219768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.286975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.288534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.290591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.387991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 428/841] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:10.394527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.483848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.500325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59625fd-7a40-4919-a774-407d60bfa81d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.537241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.538100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.538387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.538663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.550134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.551617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3ac377be-3dd9-4b56-8bfc-5bdab1a31f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:10.569733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:10.570684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:10.571856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:10.571856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:10.571856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:10.571856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:10.571856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 414/842] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:10.578197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.587714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdca7-bebd-4c01-914f-1ec56661c372 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.588015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdca7-bebd-4c01-914f-1ec56661c372 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.588267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdca7-bebd-4c01-914f-1ec56661c372 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.589878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 415/843] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:10.594786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.595063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.595525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.612955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:10.614179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:10.685618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.695790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 416/844] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:10.697836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae43f-7884-41fa-94b7-2a6e532eabe3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.711322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.740273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.741535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.742219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.742691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.744104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:10.744571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.746267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.770015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 429/845] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:10.772106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.785935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.822918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ca6b-c914-465e-86e4-b3f987bd8f85 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.858960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.859809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.860199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.860465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.861244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.863055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:10.876012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:10.877047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:10.877878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:10.882498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 417/846] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:10.883775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.895640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f27349-9010-4baa-b71f-bc2dc24f45bf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.948063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.949169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.949605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.949982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.959232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.961147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:10.978660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:10.980211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:10.982435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 430/847] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:10.989387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.005387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.020740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b7b2-6810-4ce5-aecc-b38e94da7647 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.052967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.062400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.063125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.063712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.064037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.065190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.065495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.067422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.074420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 418/848] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:11.080978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.115222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ed27-1843-4fdb-90f4-34e21170d16a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.152299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.152969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.153250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.153537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.154333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.154639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.156163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832877e-0f1c-456c-af57-4a172f9f1f88 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.168259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 431/849] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:11.169652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f36df-6d06-4c52-8efd-ad303b81ac74 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.169944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f36df-6d06-4c52-8efd-ad303b81ac74 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.170222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f36df-6d06-4c52-8efd-ad303b81ac74 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.174997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 432/850] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:11.174997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a021-7f08-4313-9475-3994c268b9a6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.174997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a021-7f08-4313-9475-3994c268b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.174997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a021-7f08-4313-9475-3994c268b9a6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.174997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 433/851] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:11.175878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a021-7f08-4313-9475-3994c268b9a6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.200173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6133-172b-4e4a-b50f-a19949e1cced None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.234564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.235447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.235759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.236214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.236935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.237240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.238642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8c91-7df3-4926-bf9c-0087991ff35b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.243619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 419/852] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:11.244873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68402-48ed-4d1b-a2b4-3bbc2c879d58 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.245131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68402-48ed-4d1b-a2b4-3bbc2c879d58 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.245429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68402-48ed-4d1b-a2b4-3bbc2c879d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.271705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.273356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dfb68402-48ed-4d1b-a2b4-3bbc2c879d58 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:11.274616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dfb68402-48ed-4d1b-a2b4-3bbc2c879d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:11.302638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a021-7f08-4313-9475-3994c268b9a6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.335603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.343718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.344862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.345154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.345416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.346256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=3770d9f2375a4c9aa2b5b514d1be39c5) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.346559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.348098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.352557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 420/853] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:11.353889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.354184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.354464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.363181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 434/854] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/role_assignments?user.id=3770d9f2375a4c9aa2b5b514d1be39c5&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:11.376620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.378201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:11.379448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:11.477873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 421/855] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:11.500857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.511499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda64f1-3a38-4bd1-843e-d31d4c6ccacf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.560764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.561709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.562278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.562436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.565085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.577233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:11.585018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:11.585964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:11.586836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 435/856] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:11.596461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.634082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a98c8-27ea-41a6-9f7b-f6c7a245d350 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.657932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.682996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.684702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.684994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.685292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.685939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.688061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:11.701603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:11.702568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:11.703387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 422/857] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:11.709244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.714320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce943-0ff2-4054-897d-b9dc51db7140 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.754662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.755340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.755651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.756011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.756785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.757085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.758602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.771635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 436/858] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:11.776419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.833401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569376-cd85-458c-bd78-9ba0861e7ebc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.848598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.870940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.871658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.871940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.872257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.872975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.873692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.874764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.883645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 423/859] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:11.885867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.902891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf224af-18bf-422c-9152-3415ec6e465c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.943980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.945212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.946327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.947046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.947462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.961610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.963337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:11.984763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:11.985943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:11.987031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:11.987031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:11.987031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:11.987031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:11.989464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 437/860] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:11.997007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.003292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375b140-34cd-457b-94c2-277b422fbf5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.045158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.045981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.046359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.046730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.047646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:12.048058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.049985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.056476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 424/861] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:12.130918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddb827-576e-4116-9703-40f2e428c8b1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.142107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.173021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.173488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.173936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.174862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:12.175306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.176891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.190890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 438/862] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:12.196952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.303653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894422-85c9-4313-812f-7d52bd79ade2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.315260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.339335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.340165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.340496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.340763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.348869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.350310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:12.365476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:12.366664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:12.367855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 425/863] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:12.372731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.476823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466344b0-70b0-4e62-b88a-0a77a6c342b8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.512453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.513129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.513404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.513672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.514515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:12.514815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.516382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.535487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 439/864] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:12.541186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.648887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b742-47fa-4abd-8260-d407572909c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.684787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.685827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.686305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.686793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.728774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.755979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.757444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.857120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 426/865] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:12.862938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.890910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.969476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cebc7-f559-4c26-8e5c-7ce0cc4a5887 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.005214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.005935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.006213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.006485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.017287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.018794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:13.036554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:13.037477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:13.038347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:13.038347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:13.038347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:13.038347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:13.038347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 440/866] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:13.043523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.118826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.143482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5256a-3b78-48f2-9ee2-b48644abd23c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.179082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.179783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.180072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.180354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.181094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:13.181408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.182891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.194882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 427/867] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:13.200617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.281836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.304332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece308-02da-4a2e-bf95-de8b5b714ccc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.345467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.346297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.346579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.346853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.355131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.357037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c01dee2d-3cc7-4a92-a82c-462759741a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:13.372603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:13.374714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:13.376664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 441/868] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:13.380487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.484629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14438cd1-6d04-4529-8b83-55c070e1f5cb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.513739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.519653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.520340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.520938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.521217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.522371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:13.523019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.525038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.537968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 428/869] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:13.540401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcad32-7ab3-4619-b485-4ff1b4192360 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.540693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcad32-7ab3-4619-b485-4ff1b4192360 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.540973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcad32-7ab3-4619-b485-4ff1b4192360 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.543655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 442/870] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:13.543784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.548030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.548323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.548606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.565734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:13.566926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:13.643631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 443/871] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:13.654219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ae48-c6fb-4a0c-a6a7-ce92f521d0db None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.665694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.689723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.690497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.690844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.691218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.692197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=6fbd6a83714a4d88ae001e7ed462fa86) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:13.692575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.694174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0e7a-0fb5-4deb-9c36-b6da63c04b4d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.700793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 429/872] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/role_assignments?user.id=6fbd6a83714a4d88ae001e7ed462fa86&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:13.755973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.779575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a93c03-ef4f-49ec-a213-d3f22f23fe36 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.793830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06ff3-f2ff-4afc-82d6-83c77a6e0dda None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.794112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06ff3-f2ff-4afc-82d6-83c77a6e0dda None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.794391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06ff3-f2ff-4afc-82d6-83c77a6e0dda None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.796164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 430/873] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:13.802489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.802772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.803049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.817688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.818367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.818649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.818924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.819697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.821129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.822876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:13.824533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:13.843663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 444/874] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:13 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:13.908097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.939453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 431/875] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:13.965345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.081403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb64d1-ed57-47b6-b875-7ff2bd81f232 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.111323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.120078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.121241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.121542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.121820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.133274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:14.141518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:14.142442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:14.143262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 445/876] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:14.150644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.255249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98255d-2429-44b1-a4b4-78f0cf8fb6b2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.294741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.295998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.296491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.296959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.298240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:14.298793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.300482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9ab8-9149-423e-afa7-72fa910e2bf4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.311001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 432/877] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:14.320674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.426964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326a5a-05e0-43c8-9f82-2deccd6b4c72 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.461749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.462941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.463418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.463903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.475887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6fc-c016-4cbc-847d-5a74919e775a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.476098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.476616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6fc-c016-4cbc-847d-5a74919e775a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.477139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6fc-c016-4cbc-847d-5a74919e775a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.477393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.479496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 433/878] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:14.485427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.485970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.486507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:14.498750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:14.499957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 446/879] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:14.506158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.511413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:14.512618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:14.551258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.555100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.596362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 434/880] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:14.620048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.620631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942603a-77f7-4a59-af43-b64ede430192 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.661484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.662150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.662427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.662695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.663420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:14.663748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.665169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.686887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 447/881] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:14.688262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.735588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02118a-6904-4c5c-8c20-341e5c59ae6d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.781731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.782751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.783254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.783756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.784715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.786501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.815987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 435/882] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:14 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:14.817047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.820523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c959-a646-4a42-be87-3ab1f6730dc7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.871622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.872840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.873335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.873885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.883108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.885139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:14.902753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:14.903857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:14.904795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:14.907419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 448/883] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:14.914240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.951728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.026874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416f7f-2e38-4ffe-adf4-adcb2f75ed98 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.064789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.065467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.065746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.066017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.066857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.067160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.068636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.087814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 436/884] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:15.093393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.194305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a2a0-40df-4d77-8daf-2c4fe49eed27 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.228128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.228699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.228977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.229248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.255349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.298024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.299488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.396847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 449/885] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:15.403331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.499774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.510380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ecdd-a225-4e4f-9bd3-16fe558514f5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.545934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.547348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.547867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.548373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.559376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.561229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:15.580077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:15.581026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:15.581924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:15.581924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:15.581924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.581924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:15.584231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 437/886] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:15.590018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.650757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.704453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4879d-8959-4521-ba1c-24b8e514d458 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.738938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.739628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.739907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.740177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.740897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.741198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.742590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.755285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 450/887] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:15.760953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.866654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2929-e08d-4b16-b8c4-9f582fd03e61 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.904164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.905364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.905842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.906331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.913512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.915200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-90f11bfd-eeca-4e42-9805-040a2ba83a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:15.929717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:15.930624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:15.931556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:15.934007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 438/888] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:15.940163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.053487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0408ca-61b7-4fda-bb02-902ab0cef046 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.060230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8583-9fc6-4f42-9e9b-07ee81d25bb5 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.060516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8583-9fc6-4f42-9e9b-07ee81d25bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.060797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8583-9fc6-4f42-9e9b-07ee81d25bb5 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.062432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 439/889] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:16.067676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d671-4754-46a1-bed3-c07133edb028 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.067961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d671-4754-46a1-bed3-c07133edb028 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.068235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d671-4754-46a1-bed3-c07133edb028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.073972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.074227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.090242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8821d671-4754-46a1-bed3-c07133edb028 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:16.091581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8821d671-4754-46a1-bed3-c07133edb028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:16.097029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.098038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.098515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.098981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.100017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.100519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.102176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.121396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 451/890] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.127786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.175563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 440/891] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:16.175563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0395-9dcf-4346-bd75-cf9e160cfcdc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.175563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0395-9dcf-4346-bd75-cf9e160cfcdc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.175563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0395-9dcf-4346-bd75-cf9e160cfcdc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.179674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 441/892] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:16.182374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.182665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.183437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.203485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:16.204736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:16.240586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401ec0-feaa-4076-9a17-89a74feba85f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.276558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.277265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 442/893] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:16.277380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.277536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.277751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.278589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] RBAC: Adding query filter params (role.id=1371c7f09722480e8a97d67052fdd48a, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=3770d9f2375a4c9aa2b5b514d1be39c5) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.278892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.280376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.284438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.296231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 452/894] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/role_assignments?user.id=3770d9f2375a4c9aa2b5b514d1be39c5&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=1371c7f09722480e8a97d67052fdd48a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:16.300738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.352099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.377843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.420212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1ec9-a829-434d-9ffa-17451a05b6e4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.423217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075321e-a685-4794-98b4-d784e7a9655c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.458467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.459290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.459595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.459876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.460543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.461972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.464041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.465181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.465661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.466145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.467095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.469144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:16.474717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:16.475837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:16.476661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:16.481548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 453/895] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:16.484580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:16.486732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:16.487964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:16.488825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:16.490242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 443/896] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:16.494923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.618201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceba22-fbdf-4e7b-adfd-19dc82708c8b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.621520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.627754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d5-8055-4d28-9839-9b3f2d4f74b5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.661157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.671666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.672825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.673249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.673438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.673855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.674186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.674560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.674945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.675184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.675664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.675958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.676360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.677526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.677914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.683389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 444/897] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.687403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 454/898] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.689098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.690333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.803380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf07e-65c7-49c6-865a-5f5c5febc441 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.817731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db1bd-e419-4256-ab63-4d69f2db004f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.842225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.842902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.843187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.843488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.844427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.844738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.846126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.851726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 445/899] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.855915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.856811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.857228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.857636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.858499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.858952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.860671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.872028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 455/900] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.873333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.942377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.990984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0062c-1453-4cca-9339-b44b3710ffa3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.028022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.028703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.028986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.029255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.030073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] RBAC: Adding query filter params (interface=public, service_id=68b1cd076e0d4a12908f522ca97162f3, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.030380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.031843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c202a71-970d-4a0b-a60c-9b9e40af4791 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.038148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 446/901] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/endpoints?service_id=68b1cd076e0d4a12908f522ca97162f3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.043819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.081940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.169450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74cf4e-587f-440d-8321-83d8648cff1b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.204310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.204979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.205265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.205535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.206232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.207659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8f07d-65bd-4587-8c71-126200890c96 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.214095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 456/902] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:17.311366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb70-eb69-4eef-a8e1-4e9f7ad38b32 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.311753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb70-eb69-4eef-a8e1-4e9f7ad38b32 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.311942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb70-eb69-4eef-a8e1-4e9f7ad38b32 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.313701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 447/903] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:17.319328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.320026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.320604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.339436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:17.341050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:17.416456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 457/904] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:17.439750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcb70-eb69-4eef-a8e1-4e9f7ad38b32 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.565209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcb70-eb69-4eef-a8e1-4e9f7ad38b32 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.583377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.600227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.605681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.605681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.605681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.605681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.605681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.616996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:17.618036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:17.618931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 448/905] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:17.625753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.652674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.725237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033f7f-4734-4de0-ad5f-986ef8263a92 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.761308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.761980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.762522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.762798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.763511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.763844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.765235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.770503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 458/906] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.776405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.887447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb394-089d-47d1-b302-2244684bc3e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.925593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.926262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.926539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.926810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.927527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.927858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.929236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.934649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 449/907] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.940621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.036434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.045893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da686-699a-4fba-b57d-665f28455bb5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.082408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.083095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.083376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.083685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.084513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] RBAC: Adding query filter params (interface=public, service_id=d7f883355d19436ea6dbfbc1455019d8, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.084824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.086257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb767-d67d-4055-8ef8-4fd46fe1c7e0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.092623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 459/908] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/endpoints?service_id=d7f883355d19436ea6dbfbc1455019d8&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:18.100672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.153127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.216126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb285977-7c74-4c20-93f3-a0079683390c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.252214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.252882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.253163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.253433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.254116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.255500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7050-65fa-4508-9dfa-3b6e9eb8eb9b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.262009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 450/909] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:18.606710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7131-ae00-4478-93c9-c67e19e4b952 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.607270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7131-ae00-4478-93c9-c67e19e4b952 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.607728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7131-ae00-4478-93c9-c67e19e4b952 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.609592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 460/910] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:18.615284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.616252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.616719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.633995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:18.635517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:18.703694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 451/911] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:18.725342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b7131-ae00-4478-93c9-c67e19e4b952 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.842836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b7131-ae00-4478-93c9-c67e19e4b952 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.878309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.879048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.879329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.879626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.890039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:18.898344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:18.899285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:18.900162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 461/912] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:18.907316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.949853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.008614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b925b-696b-419a-b40e-df20dbf9de14 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.048061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.048755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.049037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.049311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.050075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:19.050379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.051793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a040d-8fdd-4937-84c6-62f6a5d1183c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.061262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 452/913] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:19.071391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.088284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.176357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee30-6f32-436a-8633-81c8bf650286 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.211398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.212248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.212514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.212783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.214533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c665a-642f-470e-b35d-e3c9402d9ff1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.214810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c665a-642f-470e-b35d-e3c9402d9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.215078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c665a-642f-470e-b35d-e3c9402d9ff1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.216950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 453/914] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:19.224971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.225256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.225536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.228509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.230569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.245840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:19.247029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:19.249387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:19.250330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:19.251341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:19.251341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:19.251341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:19.251341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:19.253626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 462/915] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:19.264456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.325846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 454/916] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:19.352174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.353160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.389410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6cc4-f610-4f14-baba-43fd6c059ccd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.393979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.428971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.429586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.429868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.430142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.430871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:19.431178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.432607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.445451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 463/917] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:19.450813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.475174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749f5c-1dba-417a-951b-ffdf080e4dac None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.512807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.513480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.513762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.514036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.514763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.516260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c62da-56d8-43cb-ad8d-9861f0993b55 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.535598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 455/918] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:19 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:19.535598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886673f-e270-47d1-86c8-0793c2a9d3a4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.535598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886673f-e270-47d1-86c8-0793c2a9d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.535598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886673f-e270-47d1-86c8-0793c2a9d3a4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.535598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 456/919] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:19.540206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b748-4521-4139-b703-66909d331aa6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.540553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b748-4521-4139-b703-66909d331aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.540752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b748-4521-4139-b703-66909d331aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.560044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b786b748-4521-4139-b703-66909d331aa6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:19.561865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b786b748-4521-4139-b703-66909d331aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:19.568160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81955e-35b3-47cf-a3d3-1502234aa1ef None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.598873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.623107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.625133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.626065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.626682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.636828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.638700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.641492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 457/920] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:19.656908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:19.658137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:19.659082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:19.660191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786b748-4521-4139-b703-66909d331aa6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.662013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 464/921] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:19.667231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.688379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.793676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786b748-4521-4139-b703-66909d331aa6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.808973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa2e22-32c7-4737-b0e4-2d6d88113050 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.831456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.832546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.833061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.833473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.834388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.835953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.848734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.849412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.849696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.849966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:19.850278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:19.851421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:25:19.852482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:19.853247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:19.853247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.853247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.855565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 458/922] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:19.866196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.876995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 465/923] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:19.882267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.925126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.978351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.007599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effecb6d-799d-469a-b263-6a9c02709bcd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.018630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8b9c-d101-49c8-aaf8-a09d5d547825 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.055003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.056003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.056341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.056608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.069290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.070315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.070793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.071278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.072041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.073539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.074100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.074680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.076565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.089733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 459/924] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.090983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:20.097176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.098096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.098991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:20.098991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:20.098991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:20.098991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:20.103424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 466/925] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.104255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.240521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.258635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fea4-0cef-47a1-80cf-d2fc68da4910 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.287007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2f5f-da7e-4ee8-8a51-070e1afe565e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.331237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.334108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.334692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.335405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.337447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.337975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.340530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.356419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.357761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.358427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.358841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.359780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.360219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.363571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 467/926] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:20.366147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.366626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.375602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 460/927] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.379296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.399307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.508727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0242-1518-4da2-b4f2-9b466b35195b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.525372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448ddc-cc92-4ddd-8eb3-b331625626f8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.545155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.546077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.546422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.546823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.554625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.556216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.567522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.568432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.568899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.569336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.570262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.571822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0f07-3f36-48d8-bcb0-520edbe30d26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:20.571942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.572765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:20.573638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:20.578489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 468/928] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.579500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.597780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.601118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 461/929] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:20.642141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add93a3-8740-4433-80ce-693e3b40051d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.642789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add93a3-8740-4433-80ce-693e3b40051d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.642789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add93a3-8740-4433-80ce-693e3b40051d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.644547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 462/930] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:20.651885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.652536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.653009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.671504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:20.673474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:20.719439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a87c3-8214-4217-a46e-0af91436e19f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.744868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.759194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.763575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.765578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 463/931] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:20.785295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.794965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 469/932] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.796469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.888480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.920148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c6b87-7f9f-413e-81bb-8062fef3dc1b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.929920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130cf2-27c9-40e6-90d0-4d2bcb20c524 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.961881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.963085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.963587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.964094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.964951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.966541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.975052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.975982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.976263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.976537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/3770d9f2375a4c9aa2b5b514d1be39c5/roles/1371c7f09722480e8a97d67052fdd48a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.978818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=3770d9f2375a4c9aa2b5b514d1be39c5, role_id=1371c7f09722480e8a97d67052fdd48a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.980667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.982442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.983355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:25:20.984620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:20.987328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 464/933] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.993733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.011691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 470/934] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:20 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/3770d9f2375a4c9aa2b5b514d1be39c5/roles/1371c7f09722480e8a97d67052fdd48a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:25:21.065556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.113631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab0f1-8c80-48b7-821a-d38542eeae97 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.150837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.151519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.151821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.152090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.152812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.153120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.154550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.160755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 465/935] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.168729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.280026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0fc5-4de3-46f7-9c49-a62896cb1b1a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.309931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.316539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.317269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.317551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.317828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.318610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.318918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.320372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faeb43-8c68-4214-a1ce-1836c26a2985 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.326456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 471/936] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.332117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.440561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4215-f86a-45fd-bf2d-ac2ff89e9b42 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.464872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.475812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.476483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.476813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.477092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.477864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.479250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c158-7fa9-47d1-b0c5-087e254a1eb7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.501682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 466/937] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:21.905059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5c8b-bed6-4dac-b7b9-c42ed269d5e1 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.905594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5c8b-bed6-4dac-b7b9-c42ed269d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.905594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5c8b-bed6-4dac-b7b9-c42ed269d5e1 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.907282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 472/938] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:21.912714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.913161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.913260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.930770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.931982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:22.005966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 467/939] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:22.028004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d5c8b-bed6-4dac-b7b9-c42ed269d5e1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.134332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d5c8b-bed6-4dac-b7b9-c42ed269d5e1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.169054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.169926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.170210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.170483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.171144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.172774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.184875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.185868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:22.186694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 473/940] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:22.192291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.300776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72f0a7-7c2b-47ed-a3d5-0f121f3819d2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.308709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.339090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.339788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.340070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.340344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.341059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.341362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.342744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.348512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 468/941] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.356857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.419118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.464670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4477-076e-447f-8c7e-1383e5993e7e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.500392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.500627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.500897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.501170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.501968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.502273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.503709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.509219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 474/942] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.514728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.622171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140895-5527-4b3b-a7ca-c7cb1eab0c3f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.657767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.658820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.659314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.659824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.660815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] RBAC: Adding query filter params (interface=public, service_id=92035afd59504aeb9d952a8a145ec05d, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.661319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.662897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6b70c-0806-4866-beb6-9c4cd6bf6885 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.668808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 469/943] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/endpoints?service_id=92035afd59504aeb9d952a8a145ec05d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.679713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.796035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5454ac-e844-4eeb-a59b-e4fdf951a26d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.820269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.832690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.833356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.833632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.833901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.834586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.836022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733029-4139-4c32-af2b-3bfbb9bbf370 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.842704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 475/944] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:22.910958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5acfe8-540a-4cce-857b-bbee653e335b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.911322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5acfe8-540a-4cce-857b-bbee653e335b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.911520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5acfe8-540a-4cce-857b-bbee653e335b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.913382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 470/945] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:22.919323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.919853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.919945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.938448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:22.939628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:23.028567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 476/946] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:23.051822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5acfe8-540a-4cce-857b-bbee653e335b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.090827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.162228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5acfe8-540a-4cce-857b-bbee653e335b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.199058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.199793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.200075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.200349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.201095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.202760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.204408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING keystone.server.flask.common [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:25:23.229452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.sql.core [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:25:23.229452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:25:23.229452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [parameters: {'id': '89d346370ec749e28cf8e6c3367e9d50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:25:23.229452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c31a5754-327a-48e4-bdae-4b899204c675 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89d346370ec749e28cf8e6c3367e9d50.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89d346370ec749e28cf8e6c3367e9d50. May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:23.247322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 12:25:23.248251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application yield resource May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise self.value May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application session.commit() May 26 12:25:23.249186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.flush() May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application compat.raise_( May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:25:23.250192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:25:23.251073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:23.253228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [parameters: {'id': '89d346370ec749e28cf8e6c3367e9d50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.255270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.257133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89d346370ec749e28cf8e6c3367e9d50. May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.265314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 471/947] 10.222.0.75 () {60 vars in 1140 bytes} [Thu May 26 12:25:23 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:23.266829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.361767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0702a-c609-4395-9155-1d8d7bcb2d61 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.380371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.394297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188169b9-fb9b-40d1-abee-b8f0521066ea None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.394855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188169b9-fb9b-40d1-abee-b8f0521066ea None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.395039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188169b9-fb9b-40d1-abee-b8f0521066ea None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.398044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.398841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.399118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.399386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.403431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 472/948] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:23.404728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.405015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.405287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.406946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.408445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:23.423343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.425585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:23.426735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:23.427314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:23.427408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 477/949] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:23.427490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:23.431420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.507716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 473/950] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:23.532670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.545455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fa62-87f8-4645-a1fa-8c47b26c645a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.555657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.581025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.581693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.581971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.582255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.582992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.583294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.584777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.603160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 478/951] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:23.643779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043a31-2f54-4d80-b0f8-2fbbc65d28ac None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.681257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.682373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.682821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.683238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.696425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:23.705654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.707023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:23.708143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:23.711084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 474/952] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:23.717231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.765006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.838517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d866-d1b2-4861-96d1-9ff6f57e9741 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.873769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.874483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.874921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.875205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.875986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.876288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.877789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691a1c7-24c2-43a2-8d25-52da44413b0c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.886853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 479/953] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:23.892698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.922412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd397-099a-4b59-8bd2-b79cf03ede40 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.922934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd397-099a-4b59-8bd2-b79cf03ede40 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.922934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd397-099a-4b59-8bd2-b79cf03ede40 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.924634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 480/954] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:23.929318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.929595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.929862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.955224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:23.956463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:23.996064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.022827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847671ea-3d79-4676-9454-7bb84a3ae427 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.042821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 481/955] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:24.065366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.070594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.071482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.071866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.072231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.087077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.089241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:24.110150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.111131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.112050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:24.112050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:24.112050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:24.112050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:24.112350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 475/956] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.114493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.123756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.178992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcac78-c4d8-4f62-8bae-c19e9dfd0966 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.218002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.219059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.220755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.220755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.221761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.223753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.230837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc75d3-acc6-4d90-a6e6-2a0ae60de278 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.237590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.238774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:24.239656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 482/957] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.244593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.266861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.273691 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.274379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.274726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.275068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.275917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.276285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.277842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.295849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 476/958] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.296914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.376620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.385501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190409-dd3e-4872-83b0-67f39436a589 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.411860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908bd7-8086-4fcc-a93d-244d15a7d8cb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.426614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.427390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.427766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.428107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.428940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.429240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.430742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.436037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 483/959] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:24.441271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.458064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.459415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.459902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.460634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.472391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.475085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:24.492791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.493806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:24.494757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:24.499274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 477/960] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.500013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.557816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.571027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038dc97-eb7d-4b02-8760-e714bbcb8e28 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.609393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d9e5-14dc-4f17-b246-a6c09552923c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.615914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.616845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.617306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.617752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.619033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.619548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.621492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.628687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 484/961] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.652742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.653560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.653904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.654247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.655186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.655586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.657604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.678943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 478/962] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.684673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.713575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.805236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58d96-bfab-4e47-984f-52c45ddc6f70 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.843630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.844280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.844559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.844831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.916991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.918474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.942784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.022020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 485/963] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:25.028789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.137285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f451a-af26-4a84-afc8-6ecd7fad03c3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.148686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.174508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.175317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.175624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.175902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.186553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.188515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ab1c938d-28df-4dff-abfa-2ea6048e19b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:25.206648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:25.207588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:25.208490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:25.208490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:25.208490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:25.208490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:25.208490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 479/964] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:25.213820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.228495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde241-ce68-4b8f-8fb9-2b5bc079f0a4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.228767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde241-ce68-4b8f-8fb9-2b5bc079f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.229205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde241-ce68-4b8f-8fb9-2b5bc079f0a4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.231722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 480/965] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:25.236685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.236976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.237250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.255089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:25.256299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:25.322146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313618-a315-4bf3-bd9c-d3b97a9eb8a3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.335900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 481/966] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:25.345979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.353651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.368277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.369541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.370055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.370788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.372229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.372950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.375579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.399083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 486/967] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.400322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.457499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.468433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b9977-0778-4a04-bd0b-9f4d73f9c5e5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.504744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.505563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.505842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.506113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.506799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.508307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:25.521168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:25.522283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:25.523118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:25.527523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 482/968] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:25.528528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.538721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b7a7-8530-4927-a98c-7ab90445eb1f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.582902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.584055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.584513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.585388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.594920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.596881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:25.613515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:25.614471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:25.615383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:25.619768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 487/969] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:25.620706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.645536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299cf9c-aea2-4f6d-a20d-eed75a7ebccc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.667447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.695005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.695800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.696146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.696509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.697294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.697667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.699111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.709391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 483/970] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:25.710364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.733644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.746012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d984-9c38-4f3e-ba4f-dbef8a5cb30a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.798799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.799791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.801014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.801479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.802457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.802920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.805656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.825313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 488/971] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.831451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.835785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a52db-b5c5-492e-9ffb-132f5ca8be71 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.871969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.872638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.872918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.873190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.873906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.874372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.876162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.886451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 484/972] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.887324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.957204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0ed3-a1e4-4c67-bb9d-47cc7e4714d1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.958903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.994207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.996024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.996678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.996971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.997223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.998071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] RBAC: Adding query filter params (role.id=1371c7f09722480e8a97d67052fdd48a, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=3770d9f2375a4c9aa2b5b514d1be39c5) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.998385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.000063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9268ff-1cb0-4ee7-bdab-9eeef6047808 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.006163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 489/973] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/role_assignments?user.id=3770d9f2375a4c9aa2b5b514d1be39c5&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=1371c7f09722480e8a97d67052fdd48a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.007365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ac75-3128-40e6-93bc-a6253e4c96c0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.007672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ac75-3128-40e6-93bc-a6253e4c96c0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.008093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ac75-3128-40e6-93bc-a6253e4c96c0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.009449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 490/974] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:26.015497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.015857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.016095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.020688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfffe1-708b-4af7-8ada-0f6b5a0ce6da None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.035056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:26.036411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:26.060528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.062245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.062709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.063296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.064922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.066838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.104100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 485/975] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:26.132699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 491/976] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:26.158515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.280060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885a54-1355-490f-af49-54a46ef3d37f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.318355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.319043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.319327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.319706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.320433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.321881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.336410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.sql.core [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:26.336410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:25:26.336410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [parameters: {'user_id': '0f9c6a30ba854d9fa0b9c1ee0a7bd6c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:25:26.336410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() May 26 12:25:26.343790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:26.344681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application yield resource May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise self.value May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application session.commit() May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:25:26.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.flush() May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application compat.raise_( May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:25:26.346746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:26.347710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:26.348544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [parameters: {'user_id': '0f9c6a30ba854d9fa0b9c1ee0a7bd6c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:26.349376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 12:25:26.350257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:26.351208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 486/977] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 26 12:25:26 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:26.353715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.462194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.473338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec641be-97f3-40fc-bad5-f6667995f1c7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.511058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.512186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.512641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.513056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.521199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.522865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5ca30147-361b-42aa-8f74-e5608e72cbec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:26.540142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:26.541434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:26.542674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:26.545014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 492/978] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:26.551583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.555840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.668442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42dcd-dee6-4b8c-b616-f7bbe42f7654 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.720977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.721994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.722425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.722853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.724103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:26.724506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.726158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3d68-2ee0-4f10-8417-536b6adbd796 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.767328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 487/979] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.884108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65720e5-2ee3-4f87-8e96-debccf725e57 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.884740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65720e5-2ee3-4f87-8e96-debccf725e57 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.885230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65720e5-2ee3-4f87-8e96-debccf725e57 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.887154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 493/980] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:26.893448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ff66-5daf-49e3-85f6-3745f54b4898 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.893752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ff66-5daf-49e3-85f6-3745f54b4898 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.894004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ff66-5daf-49e3-85f6-3745f54b4898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.912970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d465ff66-5daf-49e3-85f6-3745f54b4898 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:26.914538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d465ff66-5daf-49e3-85f6-3745f54b4898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:26.976434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.993397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 488/981] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:27.018842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65720e5-2ee3-4f87-8e96-debccf725e57 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.132247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65720e5-2ee3-4f87-8e96-debccf725e57 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.165945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.166536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.166821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.167083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.167896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.169284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd83e-67ca-420f-a2d4-dc675dd64e81 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.189065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 494/982] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:27 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:28.384685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc588-8017-47b4-95db-cbf88bf9e034 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.385239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc588-8017-47b4-95db-cbf88bf9e034 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.385239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc588-8017-47b4-95db-cbf88bf9e034 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.386574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 489/983] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:28.392398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.392853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.392939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.410771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.412083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.420300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.448033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdf32-a3c3-49da-ae53-a2afadced070 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.448319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdf32-a3c3-49da-ae53-a2afadced070 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.448594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdf32-a3c3-49da-ae53-a2afadced070 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.451578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 490/984] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:28.456226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.456681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.456959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.476520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.477698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.496620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 495/985] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:28.518575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.546949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 491/986] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:28.570151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.632155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b889cc-d774-4663-ba45-7548c0287a00 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.670518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22adb1b-dbdd-45d1-9117-919e288c2211 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.672317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.673129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.673406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.673676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] PATH_INFO: `/v3/services/image` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.674336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.675770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.687853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.688908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:28.690527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 496/987] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:28.695264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.697386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.698488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.713545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.714361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.714641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.714993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.715582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.717041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.729505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.730500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:28.731321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 492/988] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:28.736941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.813745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a0d57-9aa3-4df5-8537-30dbbdfb315f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.847256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36659472-3746-4e4e-8519-82b4c8e56ad5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.849194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.849882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.850164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.850429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.851151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] RBAC: Adding query filter params (name=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:28.851457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.852899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.858611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 497/989] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:28.863756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.888281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825add10-a708-41f6-9741-ef4814058397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.889099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825add10-a708-41f6-9741-ef4814058397 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.889379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825add10-a708-41f6-9741-ef4814058397 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.889674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825add10-a708-41f6-9741-ef4814058397 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.890564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825add10-a708-41f6-9741-ef4814058397 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:28.890878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825add10-a708-41f6-9741-ef4814058397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.892283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825add10-a708-41f6-9741-ef4814058397 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.897436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 493/990] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:28.903061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825add10-a708-41f6-9741-ef4814058397 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.931513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.956055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.971244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fce5d-fe29-4137-86d6-5e036a3eed1d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.008280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825add10-a708-41f6-9741-ef4814058397 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.008515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.009189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.009468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.009748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.010451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] RBAC: Adding query filter params (type=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.010757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.012186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.017180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 498/991] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:29.044789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.045547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.045848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.046175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.046910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.047213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.048735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.059556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 494/992] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.061345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.175224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accbad-07ab-4888-8f23-593b80beb936 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.208047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.217975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.218679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.218962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.219241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.220112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] RBAC: Adding query filter params (interface=admin, service_id=92035afd59504aeb9d952a8a145ec05d, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.220429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.221886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0ce46-b344-4560-8473-4527f15727a8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.228290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 499/993] 10.222.0.75 () {56 vars in 1249 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/endpoints?service_id=92035afd59504aeb9d952a8a145ec05d&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:29.234723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.341164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be0fc-b406-4247-9b90-c3efb86f0654 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.354835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.377308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.377978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.378261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.378504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.379220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.380717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62752be-bf04-4849-ac27-99bf8a13782b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.387568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 495/994] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:29.401408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672cb4-8558-41d8-a455-613a5ccf8954 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.401974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672cb4-8558-41d8-a455-613a5ccf8954 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.401974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672cb4-8558-41d8-a455-613a5ccf8954 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.403662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 500/995] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:29.409780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.410123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.410303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.428580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:29.429793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:29.508043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 496/996] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:29.525549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672cb4-8558-41d8-a455-613a5ccf8954 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.636837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672cb4-8558-41d8-a455-613a5ccf8954 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.671384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.672528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.673000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.673416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.674222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.675881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:29.688885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:29.690004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:29.690889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:29.691660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 501/997] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:29.697156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.802669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1e21-03ec-4231-aade-db89f3252127 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.810708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.839369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.840078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.840358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.840625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.841328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.841630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.843066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.848324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 497/998] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.853869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.913965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.958319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bf89d-7323-473f-b6cc-9373adaef58d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.992536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.993204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.993483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.993758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.994462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.994769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.996195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.003321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 502/999] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.009044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.113346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1eac-8b0b-41e1-994a-15e193da902f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.149236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.149907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.150190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.150448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.151243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] RBAC: Adding query filter params (interface=public, service_id=8433c0004a0c400d935a0cf7bcf12af3, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:30.151564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.152959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b002-04cd-4d76-bdae-e887fb0bb2d7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.159231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 498/1000] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/endpoints?service_id=8433c0004a0c400d935a0cf7bcf12af3&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.164680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.269231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c34-dfbe-492c-b3dd-f84c4c14ea3c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.292046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.305504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.306164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.306447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.306717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.307398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.308838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e0f53-104d-42f2-aa4a-7334837fca49 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.323576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 503/1001] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:25:31.232537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4918-d745-42bf-8d4f-26c9ea5b6871 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.233092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4918-d745-42bf-8d4f-26c9ea5b6871 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.233092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4918-d745-42bf-8d4f-26c9ea5b6871 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.234687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 499/1002] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:31.240039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b71f-c447-4cb8-a42f-8836a03dcca3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.240461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b71f-c447-4cb8-a42f-8836a03dcca3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.240627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b71f-c447-4cb8-a42f-8836a03dcca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.258073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c7d3b71f-c447-4cb8-a42f-8836a03dcca3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:31.259260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c7d3b71f-c447-4cb8-a42f-8836a03dcca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:31.331133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 504/1003] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:31.354297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d4918-d745-42bf-8d4f-26c9ea5b6871 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.392919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.467655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d4918-d745-42bf-8d4f-26c9ea5b6871 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.507890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.508491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.508777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.509055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.509857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.511250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2c7fa-87fb-4a2a-9659-2c958a9adc20 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.535636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 500/1004] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:31 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:31.658789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0946ac-8baf-41ef-aaa7-75c1f8c60b3d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.659163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0946ac-8baf-41ef-aaa7-75c1f8c60b3d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.659369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0946ac-8baf-41ef-aaa7-75c1f8c60b3d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.660872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 505/1005] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:31.666806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.667045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.667355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.685527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:31.686887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:31.770050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 501/1006] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:31 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:31.794236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0946ac-8baf-41ef-aaa7-75c1f8c60b3d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.900899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0946ac-8baf-41ef-aaa7-75c1f8c60b3d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.918053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.937042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.937865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.938144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.938415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.939073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.940496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:31.952860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:31.953837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:31.954847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:31.959224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 506/1007] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:31.960314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.982384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.064314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186973a-a6cf-4994-ae05-defcdffd0c70 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.100869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.101542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.101820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.102090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.102805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.103106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.104884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.110499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 502/1008] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:32.116156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.227780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0e13-b704-4992-8f66-83a774f2ec20 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.261923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.262576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.262859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.263136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.263873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.264178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.265682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbbcf1-5713-4ba5-92ab-acc77785733c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.270824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 507/1009] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:32.276443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.364837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.384339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781466e-f359-4226-bf89-dd155c9e232e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.420758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.421422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.421695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.421969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.422720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.424123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946831c-b673-42b6-9254-3a6d8ff65c90 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.447579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 503/1010] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:32.574814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1256-c281-4556-b832-d87034b0a894 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.575181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1256-c281-4556-b832-d87034b0a894 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.575398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1256-c281-4556-b832-d87034b0a894 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.576922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 508/1011] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:32.583860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.584107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.584422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.604292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:32.605518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:32.687971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 504/1012] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:32.710762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db1256-c281-4556-b832-d87034b0a894 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.760154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.850146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db1256-c281-4556-b832-d87034b0a894 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.907692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.909060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.909542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.910021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.911269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.913743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:32.935456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:32.936637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:32.937610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:32.938389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 509/1013] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:32.944933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.023516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.056756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61402-e9e0-4335-ae3b-22c3a64baeb2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.091235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.091923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.092205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.092566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.093459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:33.093759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.095136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.100291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 505/1014] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:33.106241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.210130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047f5e-31e8-4a8b-b81c-75f55d6bbf9c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.219256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.246561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.247220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.247490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.247795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.248490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:33.248992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.250385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a4a7-bc07-48a9-b938-3579908b826b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.255683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 510/1015] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:33.261210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.362535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e414b-ee38-4da3-b976-6a626bc0d247 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.397469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.398126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.398401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.398668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.399419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.400817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21449-ca99-4fc5-9fc1-cf6e3266ad4b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.404191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.420599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 506/1016] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:33.836320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20373e5-9640-4f5c-8d61-8a206248fa5b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.836850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20373e5-9640-4f5c-8d61-8a206248fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.836850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20373e5-9640-4f5c-8d61-8a206248fa5b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.838264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 511/1017] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:33.843761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.844014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.844321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.862000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:33.863179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:33.941369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 507/1018] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:33.964019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20373e5-9640-4f5c-8d61-8a206248fa5b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.068046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20373e5-9640-4f5c-8d61-8a206248fa5b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.102548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.103419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.104100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.104372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] PATH_INFO: `/v3/services/image` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.105029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.106408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:34.118391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:34.119419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:34.120317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:34.124965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 512/1019] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:34.126376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.235793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39779b-25d3-420d-9596-2f1d2f3a812e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.255796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.276181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.276851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.277127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.277396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.278106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:34.278407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.279843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.285323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 508/1020] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.290824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.326497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.393426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97add-ad20-43f1-b24d-be3d26ae880f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.428819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.429499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.429776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.430040 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.430733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] RBAC: Adding query filter params (type=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:34.431026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.432451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.437635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 513/1021] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.443318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.551822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545408-a2f8-41c7-b95e-b0ccb4c505a8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.587690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.588297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.588574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.588887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.589638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] RBAC: Adding query filter params (interface=public, service_id=7a1e498fb55b44cc8f227297d1120b5d, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:34.589948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.591418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4c657-fa1b-4dc5-afe8-4e75c7fdb2e6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.597220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 509/1022] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/endpoints?service_id=7a1e498fb55b44cc8f227297d1120b5d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.602951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.675721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f64b-854c-420d-b161-f6a5ae727a10 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.676074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f64b-854c-420d-b161-f6a5ae727a10 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.676235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f64b-854c-420d-b161-f6a5ae727a10 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.678032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 510/1023] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:34.682901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.683195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.683432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.701017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:34.702627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:34.711443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.715424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a9dbe-e909-47e3-b946-b5ed752716cc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.743910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.755328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.756237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.756660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.757077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.757772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.759157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.766388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 514/1024] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:34.789644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 511/1025] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:34.814247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.927667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119db15-681d-47e6-adb3-8a6631bdb957 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.965369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.966174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.966463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.966735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.968236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.969688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8e78a-516b-451f-9344-ef316b79abed None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.971656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 515/1026] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.977370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.080788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823179bd-7c8f-4c5f-996a-d306ce3277ce None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.115008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.115707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.115988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.116256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.116986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.118422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ea29d-5ff4-47d3-b38c-a1f6de4400a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.145688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 512/1027] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:25:34 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:35.738193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc90be-9674-48f6-aafa-1ff027ffa954 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.738457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc90be-9674-48f6-aafa-1ff027ffa954 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.738741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc90be-9674-48f6-aafa-1ff027ffa954 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.740189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 516/1028] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:35.745744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.746212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.746290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.763979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:35.765187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:35.789410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.840421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 513/1029] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:35.863579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc90be-9674-48f6-aafa-1ff027ffa954 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.898108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.971382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc90be-9674-48f6-aafa-1ff027ffa954 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.006367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.007092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.007367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.007661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.017975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:36.026036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.026958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:36.027840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:36.029084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 517/1030] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:36.033371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.137276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d441-52ca-4c09-810d-06e3eff1867b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.172023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.172688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.172966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.173243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.174163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:36.174476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.175927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.188789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 514/1031] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:36.190058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.285390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.295957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9c8c-a4b4-4a15-9d31-05cb1c9c73bb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.332234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.333036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.333311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.333578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.344808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.346270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:36.363889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.364830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.365717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:36.365717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:36.365717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.365717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:36.365717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 518/1032] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:36.371892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.392417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.475264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32706a95-bd2c-4686-9570-56719b9deacb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.508546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.509209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.509482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.509749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.510468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:36.510765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.512160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.524568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 515/1033] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:36.530495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.630948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340c8b-63c9-437e-805b-48bf565720b6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.665292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.665292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.665292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.665660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.674131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.675620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:36.689605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.690543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:36.691518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:36.692805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 519/1034] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:36.696617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.778387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.806653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c838-c13d-4676-b897-454345145b49 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.845082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.845754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.846032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.846301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.847210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:36.847519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.848977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d962db-460a-4399-ab45-a7b9bd75d86a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.867265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 516/1035] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:36.872804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.876899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.973937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50581b6-3fc6-4ceb-884f-dc30a2df6d90 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.001496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42f6c-e371-4792-9b56-f3a5dceb0403 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.001815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42f6c-e371-4792-9b56-f3a5dceb0403 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.002039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42f6c-e371-4792-9b56-f3a5dceb0403 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.003643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 517/1036] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:37.008577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.008894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.009123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.009517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.010162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.010426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.010696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.026109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:37.027562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:37.081161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.082613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.085958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.103811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 518/1037] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:37.125893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.191061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 520/1038] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:37.194717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.197230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.235744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a99900-a886-47b8-ad7d-0f0a1ebb7f24 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.269795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.270702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.270993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.271273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] PATH_INFO: `/v3/services/image` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.271945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.273320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.285474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.286748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:37.287676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 519/1039] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:37.292633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.320638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336384-582d-4ca0-8d1c-ff3cee7fb525 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.323009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.362544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.363342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.363652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.363925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.374479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.375986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c146eb7b-d7db-4cfb-83bf-ade54778139f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:37.395285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.396294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.397168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:37.397168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:37.397168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:37.397168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:37.397168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 521/1040] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.397892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb59-3d1a-4915-a655-b968cfbd300c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.398087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb59-3d1a-4915-a655-b968cfbd300c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.398361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb59-3d1a-4915-a655-b968cfbd300c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.399628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 522/1041] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:37.401921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edb59-3d1a-4915-a655-b968cfbd300c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.409142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae795-9882-4a22-83b4-f001ecb07b56 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.437728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.443712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.444377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.444652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.444923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.445627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] RBAC: Adding query filter params (name=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.445923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.447281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74d735-4852-4484-a81e-8af4e52b208f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.452145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 520/1042] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:37.453303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.453587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.453856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.470119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:37.471280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:37.504047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edb59-3d1a-4915-a655-b968cfbd300c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.537326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.537531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 521/1043] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:37.537983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.538197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.538308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.538600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.539327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.539666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.541065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.552730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 523/1044] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:37.558216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.576586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.641783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef767824-035c-4d02-8a17-59a7472d118b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.656380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb048f-2516-4c01-9950-1592d9f50928 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.664716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.675843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.676510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.676787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.677054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.677763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.678066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.679435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.684310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 522/1045] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.684889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.695927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.696724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.697000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.697266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.704064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.705515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:37.720647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.721566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:37.722727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 524/1046] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.723388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.785589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3969c3-c48a-494c-b640-30672289d2d5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.798031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.820161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.820936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdff3-db56-402b-bba1-b0c79a324c85 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.821060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.821216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.821485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.822644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.824164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.825788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 523/1047] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.826559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.856587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.857238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.857548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.857805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.858537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.859944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.879253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 525/1048] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:37.880300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.891946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.944107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294a8f-3666-48cd-8559-095538f4e4df None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.991363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.992339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.992614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.992882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.993841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.994449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.996225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.997157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72780ec7-fb2b-428b-b487-aa5f2235e6ce None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.009259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 524/1049] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.015696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.038155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.046084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.047033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.047311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.047631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.048352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.049835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463ef94-815e-4d5b-b2f8-1a60b4df4c6d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.079572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 526/1050] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:38.136510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af70cd-503f-4714-a189-a8722d9a2d7d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.152103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.176568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.177247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.177529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.177792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.178639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] RBAC: Adding query filter params (role.id=1371c7f09722480e8a97d67052fdd48a, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.178949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.180470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1720-d200-4ebd-a595-54df59861123 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.187189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 525/1051] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=1371c7f09722480e8a97d67052fdd48a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:40.142099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a82fc-c9ab-4631-9511-ddf09115967c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.142626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a82fc-c9ab-4631-9511-ddf09115967c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.142626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a82fc-c9ab-4631-9511-ddf09115967c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.144164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 527/1052] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:40.150369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6fab-d1b7-49a7-9be2-f925c85509c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.150927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6fab-d1b7-49a7-9be2-f925c85509c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.150927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6fab-d1b7-49a7-9be2-f925c85509c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.170149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-894d6fab-d1b7-49a7-9be2-f925c85509c2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:40.171416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-894d6fab-d1b7-49a7-9be2-f925c85509c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:40.247592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 526/1053] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:40.270099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a82fc-c9ab-4631-9511-ddf09115967c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.338760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce6a49-153b-4a40-868c-55a93d312503 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.339246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce6a49-153b-4a40-868c-55a93d312503 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.339621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce6a49-153b-4a40-868c-55a93d312503 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.341154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 527/1054] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:40.347240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f361689-fc53-40c1-a045-40165b984aff None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.347523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f361689-fc53-40c1-a045-40165b984aff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.347823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f361689-fc53-40c1-a045-40165b984aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.369086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4f361689-fc53-40c1-a045-40165b984aff None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:40.370508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f361689-fc53-40c1-a045-40165b984aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:40.379027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a82fc-c9ab-4631-9511-ddf09115967c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.412560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.413110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.413388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.413656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.437488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 528/1055] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:40.438786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a42c78-5e80-4578-9ac4-b7c4bec9709d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.439071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a42c78-5e80-4578-9ac4-b7c4bec9709d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.439341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a42c78-5e80-4578-9ac4-b7c4bec9709d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.440761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 529/1056] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:40.446100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.446414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.446657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.463211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:40.464427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:40.472328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.488192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.489671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.493458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.532039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 530/1057] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:40.532954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.596121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 528/1058] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:40.597011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.638438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46d059-a79a-4c07-8e08-c39d3ae19e48 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.673880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.674716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.674970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.675241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.683015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.685916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:40.693541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.694532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:40.695370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 531/1059] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.696117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167bb6b-a736-4fa8-891f-51a72f89a702 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.696196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.725896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.733771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.734598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.734874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.735145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.745015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:40.753390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.754404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 529/1060] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.755737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.806577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca876-e58f-4c75-98b9-d16de9ad2518 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.838806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.839841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.840125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.840397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.851013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.852497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.857213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d67b-179f-41e0-a327-eda95395f528 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:40.869410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.870302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.871183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:40.871183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:40.871183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.871183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:40.871183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 532/1061] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.871470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.892790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.893451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.893727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.894000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.894738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:40.895061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.896453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.904700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 530/1062] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.905473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.921935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.955567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.977313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1905-fa86-48a3-a339-8c51b67aa4e6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.009905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125033e-0ffc-459f-a1ed-b8d8d16a28f3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.011684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.012355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.012634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.012905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.013925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.014260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.015679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.024185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 533/1063] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.024988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.044253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.045026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.045341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.045607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.046329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.046628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.048046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.059581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 531/1064] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.061467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.133014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b2a9-1786-4dc4-9646-0086d1c82bea None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.143165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.172495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.173385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.173667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.173935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] PATH_INFO: `/v3/users/68a947b6317b41cea74b19b3ada2f01e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.186986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.187606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeb911-a91e-44cd-9cc9-eab180441b8d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.190996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] RBAC: Authorizing `identity:get_user(user_id=68a947b6317b41cea74b19b3ada2f01e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.194102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.195981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 534/1065] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/users/68a947b6317b41cea74b19b3ada2f01e => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.202534 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.231133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.231889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.232322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.232647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.244886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.246370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:41.266283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.267234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.268172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:41.268172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:41.268172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.268172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:41.268394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 532/1066] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.274058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.317518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31751e-93d5-457d-8aad-807aa747caf2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.356004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.356757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.357105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.357505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.390171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf59c-35f6-4733-acf7-c521b0b38cd3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.412446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.422446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.423905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.424615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.424895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.425168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.425891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.426193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.426767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.427592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.428244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.438643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 533/1067] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.444297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.525237 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 535/1068] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:25:41.531604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.543802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca30216-ffb2-440d-9d53-6f91901d409b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.577525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.578308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.578573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.578841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.586155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.587636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:41.601215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.602159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:41.603710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 534/1069] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:41.608532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.625376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.629384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f851d-e608-48d0-87ef-1b4a073e83a4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.651896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.662873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.663776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.664057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.664335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.665502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.666948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.668701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 536/1070] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.674744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.706802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898ecf-405c-4d68-882d-7f40b4b754db None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.739221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.739919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.740199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.740472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.741304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.741611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.743056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.759558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 535/1071] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.765237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.773560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d760e4-4cc4-4c63-9412-d7ef9aa37251 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.808138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.808814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.809067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.809336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.810164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bdd4eae2658c4407a0a188393a631b65, user.id=68a947b6317b41cea74b19b3ada2f01e) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.810559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.812028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.817460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 537/1072] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/role_assignments?user.id=68a947b6317b41cea74b19b3ada2f01e&scope.project.id=bdd4eae2658c4407a0a188393a631b65&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:41.868966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.872343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e31d3-ca7b-4432-9d73-ead4bf09b766 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.914003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.914819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.915100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.915370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.927149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.928720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:41.947733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.948734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.949631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:41.949631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:41.949631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.949631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:41.949631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 536/1073] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:41.955260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.990333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.064991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363501e9-fa3b-4cd7-ab6f-5fce5f60e6ed None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.099961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.100628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.100902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.101136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.101884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.102188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.103945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.116496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 538/1074] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.122371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.223414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd923a7-3040-4c1e-8751-23c421024e52 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.256902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.257692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.257973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.258245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.265069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.266539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:42.284023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:42.285002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:42.285887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 537/1075] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:42.292305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.394074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.404765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95ff4-7f0d-47c7-8fdb-2dd8820eb964 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.439850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.440505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.440787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.441061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.441847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.442155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.443580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044579-2a98-40c7-8006-dec9b94c7c1b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.455827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 539/1076] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.461904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.477889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.569259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967485a-7219-4485-b5fe-28e12194217c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.605023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.605929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.606211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.606483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/1371c7f09722480e8a97d67052fdd48a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.609272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=29b77d3d3a1345f98194174676e35873, role_id=1371c7f09722480e8a97d67052fdd48a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.610736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6474-b058-4ed9-92f3-ab365076fed7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.625201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 538/1077] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:42 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/29b77d3d3a1345f98194174676e35873/roles/1371c7f09722480e8a97d67052fdd48a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:44.009218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077942c8-0078-43cc-a038-b1af3cf636be None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.009773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077942c8-0078-43cc-a038-b1af3cf636be None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.009773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077942c8-0078-43cc-a038-b1af3cf636be None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.011131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 540/1078] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:44.016596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.017047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.017170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.035118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:44.036349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:44.106986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 539/1079] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:44.130017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077942c8-0078-43cc-a038-b1af3cf636be None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.235218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077942c8-0078-43cc-a038-b1af3cf636be None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.270678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.271467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.271780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.272056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.282780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:44.290384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:44.291324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:44.292189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 541/1080] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:44.298392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.300845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.403431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe75a-d342-4253-b76c-52780c951c17 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.438197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.438872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.439149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.439426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.440204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:44.440506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.441885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.450398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 540/1081] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.456539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.470498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.561700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfecc80-934f-4857-ae3f-3315f9fea0c1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.597153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.598067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.598343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.598608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] PATH_INFO: `/v3/users/68a947b6317b41cea74b19b3ada2f01e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.599957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] RBAC: Authorizing `identity:get_user(user_id=68a947b6317b41cea74b19b3ada2f01e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.601449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.609149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 542/1082] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/users/68a947b6317b41cea74b19b3ada2f01e => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.610914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.675326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.715305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e815bf-b8a4-489c-9c85-3ec9d9d74495 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.749853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.750769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.751050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.751320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.752577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.754029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38a6a7-aed0-4f49-b2a2-7fe7f649eef6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.755760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 541/1083] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.761822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.785402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4f8-b2a4-4f2d-8281-a8bae9585824 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.785706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4f8-b2a4-4f2d-8281-a8bae9585824 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.785955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4f8-b2a4-4f2d-8281-a8bae9585824 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.787319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 542/1084] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:44.792482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.792762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.793033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.810191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:44.811401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:44.844341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.866936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ca536-1cf7-4421-adcd-579c98c09be1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.878622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 543/1085] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:44.900166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.901056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.901336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.901608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.901705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65/users/68a947b6317b41cea74b19b3ada2f01e/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.903666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd4eae2658c4407a0a188393a631b65, user_id=68a947b6317b41cea74b19b3ada2f01e, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.905488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.918586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 543/1086] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:44 2022] PUT /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65/users/68a947b6317b41cea74b19b3ada2f01e/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:44.965622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.009000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e515bc4-e148-45f0-b0f6-97e00013b77d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.045098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.045947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.046219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.046485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.058021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:45.066295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.067460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:45.068597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 544/1087] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:45.074057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.180633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1489-d81f-4bd7-a641-721941202677 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.215035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.215862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.216084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.216438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.217210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.217514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.218893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.224081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.228417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 544/1088] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:45.234392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.336629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0fff-e0a1-417f-a905-1fae0792d532 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.360257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.373098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.374007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.374283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.374556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.384904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.386366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:45.403846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.404768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.405658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:45.405658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:45.405658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:45.405658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:45.405658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 545/1089] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:45.411064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.515248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076de7c-3c86-4feb-bf94-2da7439380b8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.550681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.551346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.551705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.551976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.552710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.553008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.554387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.565614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 545/1090] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:45.571198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.676017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08d230-cf72-4489-85d3-096fd6566046 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.713725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.714543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.714824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.715094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.724687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.726297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:45.742106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.743287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:25:45.744336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 546/1091] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:45.749184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.814025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.856725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1cfde-a2ac-46a5-be6d-0e37c6b558b6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.890666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.891328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.891635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.891910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.892738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.893039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.894509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.911765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 546/1092] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:45.917646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.955330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.033051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0923de8-c091-4f1a-a57f-ea87c82ee36b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.071214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.072031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.072398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.072765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.160551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.162285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.199924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.277079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 547/1093] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:46.283358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.397496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48839785-d105-43b3-bc1c-a5aabe9f80f8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.416328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.435892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.436697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.436979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.437409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.450370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.452092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:46.472773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:46.473745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:46.474770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:46.474770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:46.474770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:46.474770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:46.474770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 547/1094] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:46.484949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.600799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d17e3-ecef-4e54-a126-8c6e3b0aea11 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.638164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.638928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.639208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.639485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.640250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:46.640551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.641973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.643545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.657143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 548/1095] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:46.663183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.786545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df834c6-6f32-4b63-92e1-4396e0eabfd6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.829163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.830215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.830718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.831003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.838653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.840144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:46.854757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:46.855742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:46.856650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 548/1096] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:46.863635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.982340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9263-64f1-42bb-aa74-2d982331e884 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.021349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.022019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.022302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.022572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.023366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:47.023707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.025178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad926d37-b8c9-4df5-b7d0-1c9d37dd25f3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.038055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 549/1097] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.044218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.076851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.146594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c8f5-dc07-4559-bab3-24833402073f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.181416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf40ef-a042-4115-9ebe-94b5a7c1e7e9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.181969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf40ef-a042-4115-9ebe-94b5a7c1e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.181969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf40ef-a042-4115-9ebe-94b5a7c1e7e9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.182968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.183291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 550/1098] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:47.183739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.184024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.184292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.185183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] RBAC: Adding query filter params (role.id=1371c7f09722480e8a97d67052fdd48a, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=29b77d3d3a1345f98194174676e35873) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:47.185489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.186934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.188313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.188591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.188859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.193633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 549/1099] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/role_assignments?user.id=29b77d3d3a1345f98194174676e35873&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=1371c7f09722480e8a97d67052fdd48a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.206456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:47.207916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:47.269628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.290435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 551/1100] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:47.315569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.419386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.426327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad183-2c95-4bc3-b456-4a959964510a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.461010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.461801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.462084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.462356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.473830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:47.481903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:47.483137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:25:47.484376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 550/1101] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:47.489706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.599818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03b6d7-9c0c-44cd-89ea-b176ae1a1ff2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.636928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.637614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.637955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.638231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.638979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:47.639283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.640719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.649247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 552/1102] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.655443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.760898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f60e-344b-44e2-b9ca-53eb074e9395 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.800039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.800930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.801214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.801490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] PATH_INFO: `/v3/users/68a947b6317b41cea74b19b3ada2f01e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.802739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] RBAC: Authorizing `identity:get_user(user_id=68a947b6317b41cea74b19b3ada2f01e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.804244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.805895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 551/1103] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/users/68a947b6317b41cea74b19b3ada2f01e => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.812200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.863933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.924358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084960c5-30f7-4c67-9d39-1aa8e64cef84 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.958167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.958823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.959105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.959386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.027222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.028985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.074230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.131946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 553/1104] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:48.138051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.165391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.254975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bb92-5cb9-4d0e-96ea-2f1fb2280c2e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.292254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.293126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.293405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.293674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.294993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.296477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6575-efcc-4100-be5c-975c59484781 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.298195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 552/1105] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:48.305258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.415737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcc98-f150-4f08-8937-b1d28f307708 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.453300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.453946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.454224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.454497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.455329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bdd4eae2658c4407a0a188393a631b65, user.id=68a947b6317b41cea74b19b3ada2f01e) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:48.455672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.457116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c380d-1674-46c1-9898-ee0d3eeec2e1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.463055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 554/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/role_assignments?user.id=68a947b6317b41cea74b19b3ada2f01e&scope.project.id=bdd4eae2658c4407a0a188393a631b65&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:50.661646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c80c2-28d1-4359-8fda-b7977378c8e8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.662543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c80c2-28d1-4359-8fda-b7977378c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.662543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c80c2-28d1-4359-8fda-b7977378c8e8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.664818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 553/1107] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:50.670529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.670986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.671086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.689162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:50.690348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:50.693285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.763476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 555/1108] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:50.796400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c80c2-28d1-4359-8fda-b7977378c8e8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.893116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.904222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c80c2-28d1-4359-8fda-b7977378c8e8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.940282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.941112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.941431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.941746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.943007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.944477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f61e5-4784-40ab-ac0f-814b2cae4424 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.946191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 554/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:50.952888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.063871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fda0c7-ff47-4668-9baa-84c8cf0ccdd4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.102811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.103852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.104221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.104519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.105599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.108013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e867b9-b0b4-4f73-bef4-15e55a9950dc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.123059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.139505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 556/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:25:50 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:53.343173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c72a-9184-43d8-a09b-582401a18b13 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.344137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c72a-9184-43d8-a09b-582401a18b13 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.344137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c72a-9184-43d8-a09b-582401a18b13 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.346320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 555/1111] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:53.351821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaec69-617d-4871-9079-eed99be6202c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.352635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaec69-617d-4871-9079-eed99be6202c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.352734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaec69-617d-4871-9079-eed99be6202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.371458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-09eaec69-617d-4871-9079-eed99be6202c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:53.372922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-09eaec69-617d-4871-9079-eed99be6202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:53.443080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 557/1112] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:53.467432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c72a-9184-43d8-a09b-582401a18b13 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.584162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c72a-9184-43d8-a09b-582401a18b13 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.621480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.622383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.622672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.622942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] PATH_INFO: `/v3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.624455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] RBAC: Authorizing `identity:get_role(role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.625830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.627243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 556/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:53.633511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaec69-617d-4871-9079-eed99be6202c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.734497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaec69-617d-4871-9079-eed99be6202c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.760357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.771035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.771954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.772227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.772493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] PATH_INFO: `/v3/users/1ed742ad18334ea1b206bc58e0afc415` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.787844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed742ad18334ea1b206bc58e0afc415)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.789335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.790986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 558/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/users/1ed742ad18334ea1b206bc58e0afc415 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:53.798171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.827197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.905561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258065a-a465-4bff-b95d-182fa40116f1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.944757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.945396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.945677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.945948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.017025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.018490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.047784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.122483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 557/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:54.132359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.242626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee603-5a04-456d-be99-b1938f3c03c5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.277746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.278647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.279010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.279283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.280607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.282054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4044524-6086-42c2-8b60-71a3cff42b9f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.283754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 559/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:54.290836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.401699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd199595-69c5-4f87-be66-7e1cf0be7189 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.427665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.437130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.437778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.438063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.438356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.439162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=bdd4eae2658c4407a0a188393a631b65, user.id=1ed742ad18334ea1b206bc58e0afc415) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:54.439469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.440954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870629-9ea2-4c62-ac38-9024e74b5deb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.446363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 558/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/role_assignments?user.id=1ed742ad18334ea1b206bc58e0afc415&scope.project.id=bdd4eae2658c4407a0a188393a631b65&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:56.589058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7405748-3592-4378-b92c-f8c34e5c5c25 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.589971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7405748-3592-4378-b92c-f8c34e5c5c25 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.589971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7405748-3592-4378-b92c-f8c34e5c5c25 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.592495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 560/1118] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:56.598350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.598802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.598891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.616707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:56.617872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:56.686534 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 559/1119] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:56.709780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7405748-3592-4378-b92c-f8c34e5c5c25 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.768639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.823117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7405748-3592-4378-b92c-f8c34e5c5c25 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.871291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.872112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.872384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.872651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] PATH_INFO: `/v3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.874174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] RBAC: Authorizing `identity:get_role(role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.875568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.876962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 561/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:56.883901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.985755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4e1f-0d92-4a2e-98c7-5e7d36598bf5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.005540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.021809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.022685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.022970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.023244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] PATH_INFO: `/v3/users/1ed742ad18334ea1b206bc58e0afc415` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.024546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] RBAC: Authorizing `identity:get_user(user_id=1ed742ad18334ea1b206bc58e0afc415)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.026067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.027753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 560/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/users/1ed742ad18334ea1b206bc58e0afc415 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.034337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.140208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab04a3-1dd5-4077-a097-8d9c995b4cf8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.165177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.181236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.182099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.182375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.182643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.183986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.185461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd5ce0-9c30-4cd6-90e9-d00b285ef105 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.187141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 562/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.193382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.297796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27318-e404-4a34-b1ed-50cbb487b51f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.333443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.334324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.334606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.334883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65/users/1ed742ad18334ea1b206bc58e0afc415/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.337506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd4eae2658c4407a0a188393a631b65, user_id=1ed742ad18334ea1b206bc58e0afc415, role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.338939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999927-81b5-4886-a4e4-26e7ae97e566 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.354697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 561/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:25:57 2022] PUT /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65/users/1ed742ad18334ea1b206bc58e0afc415/roles/a3f39bef9153404990abaf0bdd0608ac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:59.545258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc142f-d5ba-44e0-848b-1c776b7de5d3 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.546181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc142f-d5ba-44e0-848b-1c776b7de5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.546181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc142f-d5ba-44e0-848b-1c776b7de5d3 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.548444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 563/1124] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:25:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:59.554869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.555622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.555781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.576053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:59.577237 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:59.626099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.653081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 562/1125] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:59.676937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc142f-d5ba-44e0-848b-1c776b7de5d3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.787220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc142f-d5ba-44e0-848b-1c776b7de5d3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.821283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.822090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.822367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.822633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] PATH_INFO: `/v3/roles/a3f39bef9153404990abaf0bdd0608ac` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.824112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] RBAC: Authorizing `identity:get_role(role_id=a3f39bef9153404990abaf0bdd0608ac)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.825628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.827385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 564/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/roles/a3f39bef9153404990abaf0bdd0608ac => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.833416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.932688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931330e2-d5b5-41f1-bca8-a95a9c3d6c1f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.968458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.969334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.969610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.969882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] PATH_INFO: `/v3/users/1ed742ad18334ea1b206bc58e0afc415` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.971115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed742ad18334ea1b206bc58e0afc415)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.972588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.974220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 563/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/users/1ed742ad18334ea1b206bc58e0afc415 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.980748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.040736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.092046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1654f47-f50d-4671-8b28-8c07a48330e8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.126927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.127579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.127872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.128141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.196360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.197823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.255021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.300498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 565/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:00.306810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.360088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.426485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8e1d-6075-4369-8a14-b8fe63029c49 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.461717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85402954-ac27-483d-aef4-30380125a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.462577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402954-ac27-483d-aef4-30380125a324 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.462857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402954-ac27-483d-aef4-30380125a324 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.463129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402954-ac27-483d-aef4-30380125a324 None admin] PATH_INFO: `/v3/projects/bdd4eae2658c4407a0a188393a631b65` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.464467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85402954-ac27-483d-aef4-30380125a324 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd4eae2658c4407a0a188393a631b65)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.466026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85402954-ac27-483d-aef4-30380125a324 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.467785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 564/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/projects/bdd4eae2658c4407a0a188393a631b65 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:00.474309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.582515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753402f9-1430-486d-8dce-9cde60720855 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.617804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.618376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.618654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.618930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.619788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] RBAC: Adding query filter params (role.id=a3f39bef9153404990abaf0bdd0608ac, scope.project.id=bdd4eae2658c4407a0a188393a631b65, user.id=1ed742ad18334ea1b206bc58e0afc415) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:00.620101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.621622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c5e4-7194-4bc0-b17b-5fc1cfc56d3b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.627653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 566/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/role_assignments?user.id=1ed742ad18334ea1b206bc58e0afc415&scope.project.id=bdd4eae2658c4407a0a188393a631b65&role.id=a3f39bef9153404990abaf0bdd0608ac => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:02.865074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4a9e-d2b6-4500-b205-480bdd32599c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.865645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4a9e-d2b6-4500-b205-480bdd32599c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.865645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4a9e-d2b6-4500-b205-480bdd32599c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.867845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 565/1131] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:02.877627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.878020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.878237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.900629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:02.901815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:02.918314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.979813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 567/1132] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:03.015926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4a9e-d2b6-4500-b205-480bdd32599c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.139938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4a9e-d2b6-4500-b205-480bdd32599c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.154275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.186657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.187441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.187752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.188024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.189245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.190684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4204b-5efe-40ad-a0c2-6b625806346d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.192325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 566/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.198249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.303107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d12323-7e87-4d4c-abbe-f0b73eb41387 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.338287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.338931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.339204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.339474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.340243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.341688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a7917-9351-4fd6-b8c4-d8e8410e72bc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.368295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 568/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:26:03 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:05.606429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf74c6-ca02-4e70-b123-ace386d6cf62 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.607376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf74c6-ca02-4e70-b123-ace386d6cf62 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.607376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf74c6-ca02-4e70-b123-ace386d6cf62 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.609179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 567/1135] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:05.617952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.618381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.618540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.625589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:05.639963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:05.641153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:05.711899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 569/1136] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:05.744603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf74c6-ca02-4e70-b123-ace386d6cf62 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:05.853614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf74c6-ca02-4e70-b123-ace386d6cf62 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:05.888486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:05.889206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.889486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.889757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.890987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:05.892452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22856d0e-f2f8-4235-bc7f-f1c2125cf5ee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:05.894093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 568/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:05.900218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.004315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf66cd-affc-4c2b-ac5f-525146cce7a6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.034243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.040730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.041387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.041649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.041919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.042619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.044117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bed869-6b51-4c8d-b7d3-e65d86bd0bd9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.066234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 570/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:26:05 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:08.282608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b225-7b69-457c-994b-f976e6b24dd2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.283481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b225-7b69-457c-994b-f976e6b24dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.283481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b225-7b69-457c-994b-f976e6b24dd2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.285748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 569/1139] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:08.292030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571b60-70f3-4629-98df-f2589666b484 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.292485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571b60-70f3-4629-98df-f2589666b484 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.292577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571b60-70f3-4629-98df-f2589666b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.320472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-79571b60-70f3-4629-98df-f2589666b484 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:08.321667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-79571b60-70f3-4629-98df-f2589666b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:08.392863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 571/1140] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:08.421170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3b225-7b69-457c-994b-f976e6b24dd2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.477004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:08.541814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3b225-7b69-457c-994b-f976e6b24dd2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.589615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.590426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.590706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.590982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.602718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:08.610337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:08.611446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:08.612415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 570/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:08.620559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571b60-70f3-4629-98df-f2589666b484 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.731614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571b60-70f3-4629-98df-f2589666b484 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.749226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:08.768257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.768923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.769202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.769492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.770246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:08.770551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.771990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.780276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 572/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:08.786301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.897667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43825-e01e-43a6-ae55-c9db23085920 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.907802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:08.932683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.933547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.933821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.934085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] PATH_INFO: `/v3/users/44f3a94b3c50415597a43f1ee77f95a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.947743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] RBAC: Authorizing `identity:get_user(user_id=44f3a94b3c50415597a43f1ee77f95a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.949179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.950808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 571/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/users/44f3a94b3c50415597a43f1ee77f95a9 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:08.957007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.068785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81bfb-10e9-45b2-b415-96dddafdd6ee None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.112103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.112731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.113013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.113283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.162841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.182436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.183943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.282412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 573/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:09.288451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.390446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ccd2d-3e45-4da1-9bdf-f0e466c03b76 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.425985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.426794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.427070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.427341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] PATH_INFO: `/v3/projects/9f6858dc340544c09c071756b0f8fcaf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.428685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] RBAC: Authorizing `identity:get_project(project_id=9f6858dc340544c09c071756b0f8fcaf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.430107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b900-4852-4da4-90a4-e4a3b42c4a3b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.431818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 572/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/projects/9f6858dc340544c09c071756b0f8fcaf => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.438203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.526412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.547671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ee4e-5c90-44cf-86a6-5ed1484baad5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.582364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.583001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.583276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.583577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.584401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=9f6858dc340544c09c071756b0f8fcaf, user.id=44f3a94b3c50415597a43f1ee77f95a9) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.584709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.586145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dffa6-96f6-404c-8706-a0c5a066929f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.594374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 574/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/role_assignments?user.id=44f3a94b3c50415597a43f1ee77f95a9&scope.project.id=9f6858dc340544c09c071756b0f8fcaf&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:11.764067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e6e6-83e3-4771-98bc-8ad92ccc0edf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.764935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e6e6-83e3-4771-98bc-8ad92ccc0edf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.764935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e6e6-83e3-4771-98bc-8ad92ccc0edf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.767257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 573/1147] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:11.774466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.774900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.775148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.800311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:11.801493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:11.870665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 575/1148] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:11.893296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9e6e6-83e3-4771-98bc-8ad92ccc0edf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.932032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.998291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9e6e6-83e3-4771-98bc-8ad92ccc0edf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.034343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.035055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.035329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.035591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.048136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:12.055722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:12.056894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:12.058055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 574/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:12.064413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.141580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.169074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba4496-7033-497d-849a-48201b5e0ffb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.203808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.204452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.204735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.205006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.205741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:12.206034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.207417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.216864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 576/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:12.227050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.334373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.343086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c3b0-f77c-44ba-bfa8-5471ed72f6d4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.387853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.388801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.389070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.389338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] PATH_INFO: `/v3/users/44f3a94b3c50415597a43f1ee77f95a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.390541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] RBAC: Authorizing `identity:get_user(user_id=44f3a94b3c50415597a43f1ee77f95a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.392021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.393637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 575/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/users/44f3a94b3c50415597a43f1ee77f95a9 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:12.402157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.508751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206159ad-3dee-4e1d-98cb-def70226efbc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.544110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.545149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.545468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.545728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] PATH_INFO: `/v3/projects/9f6858dc340544c09c071756b0f8fcaf` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.547026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] RBAC: Authorizing `identity:get_project(project_id=9f6858dc340544c09c071756b0f8fcaf)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.548491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44301e78-67fe-4316-900d-fbcf06cd5eff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.550146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 577/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/projects/9f6858dc340544c09c071756b0f8fcaf => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:12.556932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.675570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbbf67-76fe-4842-bf7e-54994ad0474e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.709926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.710806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.711086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.711356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] PATH_INFO: `/v3/projects/9f6858dc340544c09c071756b0f8fcaf/users/44f3a94b3c50415597a43f1ee77f95a9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.713578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6858dc340544c09c071756b0f8fcaf, user_id=44f3a94b3c50415597a43f1ee77f95a9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.715010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32ff4-1d9a-4e05-a7d9-4fb24996c0b5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.733460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 576/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:26:12 2022] PUT /identity/v3/projects/9f6858dc340544c09c071756b0f8fcaf/users/44f3a94b3c50415597a43f1ee77f95a9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:14.907724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823b31-7832-4710-bf8a-d1db95c65e31 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:14.908601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823b31-7832-4710-bf8a-d1db95c65e31 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:14.908601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823b31-7832-4710-bf8a-d1db95c65e31 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:14.910869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 578/1154] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:14.917362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:14.917816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:14.917916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:14.937109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:14.938296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:14.957866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.012100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 577/1155] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:15.041735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823b31-7832-4710-bf8a-d1db95c65e31 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.045936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.151211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823b31-7832-4710-bf8a-d1db95c65e31 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.186164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.186953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.187228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.187501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.198375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:15.205923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:15.206974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:26:15.208283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 579/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:15.216836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.319811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b94a-1a61-492e-8fa2-b948e65f85ab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.358611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.359265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.359577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.359849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.360580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:15.360889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.362268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.370453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 578/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:15.377237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.450097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.495861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847374c-dc97-4f11-8e43-e2f5c0c79233 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.528783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.529718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.530031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.530305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] PATH_INFO: `/v3/users/44f3a94b3c50415597a43f1ee77f95a9` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.531649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] RBAC: Authorizing `identity:get_user(user_id=44f3a94b3c50415597a43f1ee77f95a9)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.533141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.534772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 580/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/users/44f3a94b3c50415597a43f1ee77f95a9 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:15.541190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.560411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.645704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebb60-3fce-4749-8e6e-ad756f4697c5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.683072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.683734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.684014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.684282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.753313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.754772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.771903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.855819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 579/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:15.862384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.980141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644412-252d-4b47-af5b-a31859abafd1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.009704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.016032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.016887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.017165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.017441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] PATH_INFO: `/v3/projects/9f6858dc340544c09c071756b0f8fcaf` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.018728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6858dc340544c09c071756b0f8fcaf)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.020213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e0887-8536-464d-a560-e6b4d144bca9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.021914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 581/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/projects/9f6858dc340544c09c071756b0f8fcaf => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:16.028898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.139808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ca82-6432-4b78-8126-5115e07fb931 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.156390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.176127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.176769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.177050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.177319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.178145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=9f6858dc340544c09c071756b0f8fcaf, user.id=44f3a94b3c50415597a43f1ee77f95a9) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:16.178453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.179917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccbea-dc74-44e9-afee-333f9da894ba None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.185881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 580/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/role_assignments?user.id=44f3a94b3c50415597a43f1ee77f95a9&scope.project.id=9f6858dc340544c09c071756b0f8fcaf&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:18.402295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92afa6-8b5d-43b2-9cd4-41bf7b835277 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.402983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92afa6-8b5d-43b2-9cd4-41bf7b835277 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.402983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92afa6-8b5d-43b2-9cd4-41bf7b835277 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.404443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 582/1162] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:18.410902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.411720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.411849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.433547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:18.434752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:18.522251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 581/1163] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:18.554564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92afa6-8b5d-43b2-9cd4-41bf7b835277 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:18.672801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92afa6-8b5d-43b2-9cd4-41bf7b835277 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:18.707195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:18.707867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.708151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.708420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.777525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:18.781207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:18.783736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:18.901316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 583/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:26:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:18.910694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:19.014464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839da586-004d-4c91-9740-6e660a23cc3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:19.025744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:19.053731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:19.054525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:19.054794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:19.055057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:19.062333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:19.063799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-527b03e9-4898-4ed2-8672-3d2b34f4d59c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:19.078526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:19.079753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:19.080830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 582/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:26:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:19.085936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:19.185339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:19.188355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309122-8377-4671-a8a1-e98802369f87 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:19.223101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:19.223772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:19.224043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:19.224309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:19.225383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:19.225680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:19.227048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61494-e3ef-4f29-9515-fc2e523d2b18 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:19.234216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 584/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 26 12:26:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:21.398718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e0da-b097-4fa4-8c24-a8f6a6b55f16 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.399289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e0da-b097-4fa4-8c24-a8f6a6b55f16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.399289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24e0da-b097-4fa4-8c24-a8f6a6b55f16 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.400694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 583/1167] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:21.407103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae971-abd6-4c6d-9713-f0598bda4a51 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.407918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae971-abd6-4c6d-9713-f0598bda4a51 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.408073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae971-abd6-4c6d-9713-f0598bda4a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.429830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-29eae971-abd6-4c6d-9713-f0598bda4a51 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:21.431009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-29eae971-abd6-4c6d-9713-f0598bda4a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:21.502834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 585/1168] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:21.525473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24e0da-b097-4fa4-8c24-a8f6a6b55f16 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.633315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24e0da-b097-4fa4-8c24-a8f6a6b55f16 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.668077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.669731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.669731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.669731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.670052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.671430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f682f7c-cc3e-401e-b088-b1ddd8b8c6a8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.689602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 584/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Thu May 26 12:26:21 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:23.895059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521bf5-2f5b-4753-bab0-2cd5f007cf5b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.895670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521bf5-2f5b-4753-bab0-2cd5f007cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.895670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521bf5-2f5b-4753-bab0-2cd5f007cf5b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.897010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 586/1170] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:23.903521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.903995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.904094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.927530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:23.928772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:23.954545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.012263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 585/1171] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:24.035899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a521bf5-2f5b-4753-bab0-2cd5f007cf5b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.142868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.153952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a521bf5-2f5b-4753-bab0-2cd5f007cf5b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.192938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.193815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.194091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.194363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] PATH_INFO: `/v3/domains/39338589cf8449dfa61d08c0878d030b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.207008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=39338589cf8449dfa61d08c0878d030b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.208563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf8a3-f07d-4b60-a475-b9a3ba3ac1b9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.210203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 587/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Thu May 26 12:26:24 2022] GET /identity/v3/domains/39338589cf8449dfa61d08c0878d030b => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:24.217057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.317541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2c547-f949-4eff-8ac7-54324c84ea80 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.362051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.362699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.362978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.363252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.363999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.365438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8fb95-2977-46d3-853c-294109447080 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.398599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 586/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:26:24 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:26.603683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9fb2e-57d8-448a-a854-99630e9981ab None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.604282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9fb2e-57d8-448a-a854-99630e9981ab None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.604282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9fb2e-57d8-448a-a854-99630e9981ab None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.605558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 588/1174] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:26.614902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.615597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.615788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.640868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:26.642067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:26.649311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:26.721311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 587/1175] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:26.750328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9fb2e-57d8-448a-a854-99630e9981ab None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.866454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9fb2e-57d8-448a-a854-99630e9981ab None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:26.901414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:26.902272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.902727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.902863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] PATH_INFO: `/v3/domains/39338589cf8449dfa61d08c0878d030b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.904131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=39338589cf8449dfa61d08c0878d030b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:26.905594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83dcf0-429d-4c2d-ac03-db18976a0956 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:26.907193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 589/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/domains/39338589cf8449dfa61d08c0878d030b => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:26.913644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:27.017802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d41e0-47d7-4d15-ad61-7f30851264c2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.052721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.053377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.053657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.053934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.054641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.056110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509284-9b4a-44cf-b11e-3a02afed9088 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:27.074498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:27.081322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 588/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:26:26 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:29.285201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520713-9b37-477e-a114-4f682b5295d1 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.286075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520713-9b37-477e-a114-4f682b5295d1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.286075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520713-9b37-477e-a114-4f682b5295d1 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.288326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 590/1178] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:29.294854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.295610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.295741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.318215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:29.319402 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:29.393253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 589/1179] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:29.420937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29520713-9b37-477e-a114-4f682b5295d1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:29.452812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:29.541773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29520713-9b37-477e-a114-4f682b5295d1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:29.587833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:29.589000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.589412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.589810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.602669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:29.613169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:29.614259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:26:29.615249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 591/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:29.623122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:29.725854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2523e2-7d3b-422e-a9d3-477c286d17d5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:29.754445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:29.767337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:29.768324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.768706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.769088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.772535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:29.772535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:29.772535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:29.783110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 590/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:29.789088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:29.870114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:29.895463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ced08-a83f-4c85-94c6-149efb50de57 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:29.932213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:29.933145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.934501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.934501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] PATH_INFO: `/v3/users/7f01c63141c342aca91d39447e26091a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.950196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] RBAC: Authorizing `identity:get_user(user_id=7f01c63141c342aca91d39447e26091a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:29.951729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:29.953453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 592/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:29 2022] GET /identity/v3/users/7f01c63141c342aca91d39447e26091a => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:29.960378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.073156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc811f-7eab-418c-ba1e-1a90f09986ba None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.107643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.108284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.108560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.108826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.166620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.183713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.185185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.292527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 591/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:26:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:30.299661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.420959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d3c83-8bec-4469-882b-a1cb58529c07 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.457306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.458161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.458437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.458706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] PATH_INFO: `/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.460049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2158c19e3476bb62e9ca7c38cc24f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.461500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7aa07-58d9-4ec5-84ee-159574c6f5a1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.463189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 593/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:30.472922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.571946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.588338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f37d-e144-4fc5-80fa-4968e1c8de21 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.633082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.634062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.634430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.634800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.636130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=d2e2158c19e3476bb62e9ca7c38cc24f, user.id=7f01c63141c342aca91d39447e26091a) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:30.636539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.638085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1649dda-6cc9-4109-a7b3-e5bcb9f7c580 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.644411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 592/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/role_assignments?user.id=7f01c63141c342aca91d39447e26091a&scope.project.id=d2e2158c19e3476bb62e9ca7c38cc24f&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:32.815105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce5937-a6b7-40d7-b7f6-04b995f3f789 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.815628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce5937-a6b7-40d7-b7f6-04b995f3f789 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.815628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce5937-a6b7-40d7-b7f6-04b995f3f789 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.817720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 594/1186] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:32.823000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f775d-301c-449f-81cc-7f020718da1b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.823439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f775d-301c-449f-81cc-7f020718da1b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.823557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f775d-301c-449f-81cc-7f020718da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.843823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-267f775d-301c-449f-81cc-7f020718da1b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:32.845013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-267f775d-301c-449f-81cc-7f020718da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:32.921563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 593/1187] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:32.944677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce5937-a6b7-40d7-b7f6-04b995f3f789 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.957954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:33.063614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce5937-a6b7-40d7-b7f6-04b995f3f789 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.101275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.102085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.102326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.102595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.117001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:33.126119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:33.127190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:26:33.128230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 595/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:33.133393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f775d-301c-449f-81cc-7f020718da1b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:33.219794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:33.237996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f775d-301c-449f-81cc-7f020718da1b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.273183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.273836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.274113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.274382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.275126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:33.275433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:33.276835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:33.285007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 594/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:33.294650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:33.370017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:33.408695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5de0-82d2-425c-9715-c0a2409e7051 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.443827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.444688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.444964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.445232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] PATH_INFO: `/v3/users/7f01c63141c342aca91d39447e26091a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.446529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f01c63141c342aca91d39447e26091a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:33.448011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:33.449653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 596/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:33 2022] GET /identity/v3/users/7f01c63141c342aca91d39447e26091a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:33.455747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:33.564325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781a17-d832-4e6a-a372-0b13f2c79063 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.599383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.600272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.600546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.600812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] PATH_INFO: `/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.602116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2158c19e3476bb62e9ca7c38cc24f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:33.603577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4cc61-366e-40dc-b1cb-97ab7ea3c0fa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:33.605343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 595/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:33 2022] GET /identity/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:33.611847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:33.716082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9cb67-9904-40d2-8bee-4a88791d49e2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.752859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.753745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.754022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.754295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] PATH_INFO: `/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f/users/7f01c63141c342aca91d39447e26091a/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.756358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2158c19e3476bb62e9ca7c38cc24f, user_id=7f01c63141c342aca91d39447e26091a, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:33.757792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929de3a-8fa3-44ce-9e8e-aa0eae981109 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:33.761093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:33.776757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 597/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:26:33 2022] PUT /identity/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f/users/7f01c63141c342aca91d39447e26091a/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:36.004025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b4bf-24ed-49bb-9557-e2a49a0c78bc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.004993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b4bf-24ed-49bb-9557-e2a49a0c78bc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.004993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b4bf-24ed-49bb-9557-e2a49a0c78bc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.007178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 596/1193] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:26:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:36.016247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.016973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.017123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.040207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:36.041364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:36.117966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 598/1194] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:36.141980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141b4bf-24ed-49bb-9557-e2a49a0c78bc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.161774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.253581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141b4bf-24ed-49bb-9557-e2a49a0c78bc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.290717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.291441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.291760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.292041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.303231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:36.311017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:36.312234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:26:36.313150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 597/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:36.319261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.430915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d3dba-1123-444a-baaa-bd3d2ec76cc7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.456762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.466460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.467115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.467397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.467706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.468449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:36.468753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.470128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.480627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 599/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:36.486530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.562778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.592600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb65e3-dfdf-4705-a3d5-8ca9f069074d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.629309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.630171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.630447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.630714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] PATH_INFO: `/v3/users/7f01c63141c342aca91d39447e26091a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.631947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] RBAC: Authorizing `identity:get_user(user_id=7f01c63141c342aca91d39447e26091a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.633379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.635023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 598/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/users/7f01c63141c342aca91d39447e26091a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:36.641908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.755599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10c32-8f56-4037-84e0-bb90aff67464 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.790817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.791469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.791784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.792062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.848813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.862280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.863816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.975745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 600/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:26:36.982393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.090334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dacb-dfda-4204-8bd8-a770665fe1ff None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.126151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.126946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.127226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.127497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] PATH_INFO: `/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.128770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2158c19e3476bb62e9ca7c38cc24f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.130212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2b07-a568-4e7e-a3bf-507e1b892aa0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.131958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 599/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/projects/d2e2158c19e3476bb62e9ca7c38cc24f => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:37.138996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.242306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:37.255940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62b0-9ccc-4bcf-8ab6-eb0af60c47ec None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.291681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.292420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.292913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.293239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.294084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=d2e2158c19e3476bb62e9ca7c38cc24f, user.id=7f01c63141c342aca91d39447e26091a) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:37.294399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.295885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a11f-9efd-49e2-a658-d48a05b6c182 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.301882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 601/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/role_assignments?user.id=7f01c63141c342aca91d39447e26091a&scope.project.id=d2e2158c19e3476bb62e9ca7c38cc24f&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:47.121039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:47.299175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=24 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:37.804108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f088cb-9596-4e0c-9a71-6629e5ed0edd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.804753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f088cb-9596-4e0c-9a71-6629e5ed0edd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.804753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f088cb-9596-4e0c-9a71-6629e5ed0edd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.806233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 600/1201] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:37.814054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.814703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.814703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.833392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:37.834616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:37.917499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 602/1202] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:27:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:27:37.941571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f088cb-9596-4e0c-9a71-6629e5ed0edd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.070621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f088cb-9596-4e0c-9a71-6629e5ed0edd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.129193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.130141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.130431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.130718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.142537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.144249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:38.171976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:38.173073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:38.174048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:38.174048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:38.174048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:38.174048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:38.176486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 601/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:38.177731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.305662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3bd64-8544-4c0e-9fdd-64043ef0e82d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.348322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.354996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.355744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.356225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.357019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.357882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:38.358251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.359855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3502725-8143-4069-974a-a76eb4c4fb3a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.373205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 603/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:38.379165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.450123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.514714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a34c-2186-4d50-952f-dcf6315e7ca2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.554925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.555635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.555918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.556185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.557008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.558518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82125-fb47-4714-b06f-46796b4aacab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.588645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 602/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 26 12:27:38 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:41.049611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eef28-38a4-4051-b1e7-59f7196ce5c3 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.050295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eef28-38a4-4051-b1e7-59f7196ce5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.050295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eef28-38a4-4051-b1e7-59f7196ce5c3 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.051665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 604/1206] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:41.056986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.057408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.057513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.076387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:41.077774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:41.151294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 603/1207] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:41.175128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55eef28-38a4-4051-b1e7-59f7196ce5c3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.283869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55eef28-38a4-4051-b1e7-59f7196ce5c3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.324376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.325111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.325397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.325656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.337363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:41.345702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:41.347026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:41.347984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 605/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:41.353093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.393806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.464861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab0070-7ff8-4143-95d6-e061f8ae0179 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.513320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.513982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.514264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.514535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.515334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:41.515606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.516984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.526781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 604/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:41.533578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.596688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.669236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339cb7-c6ef-48cf-992b-0e3fad74a67a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.706373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.707398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.707799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.708069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.720396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.721944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:41.744125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:41.750318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:41.751481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:41.751481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:41.751481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:41.751481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:41.751481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 606/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:41.751855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.870105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.873763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ac14-d2be-4a5c-9488-07e9524f74eb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.916544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.917184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.917486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.917785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.918585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:41.918937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.920518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.935339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 605/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:41.944407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.058912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35f548-de87-4956-94d1-e7e8f238f352 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.061373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.099810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.100841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.101194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.101549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.110108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.111600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:42.128761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:42.129997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:42.136557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 607/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:42.137608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.253275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b05c-c7b8-4adf-9edf-96c0e4bde113 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.295157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.296081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.296340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.296639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.297603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:42.297974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.299440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.320306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 606/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:42.326152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.455085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bda8-6fc0-4fe6-bd09-7320beb15b22 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.494339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.495141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.495423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.495728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.535357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.583768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.585512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.708292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 608/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:42.715008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.738801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.847375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96533-e9fc-4d8c-a4da-96a8af9770b6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.881038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.881879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.882197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.882473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.894129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.895678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:42.913457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:42.914593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:42.915739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:42.915739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:42.915739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:42.915739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:42.915739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 607/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:42.922298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.994400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.041213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d63d43-5d83-4ea8-9ef5-6a22f8da3bd3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.080453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.081100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.081422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.081652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.082694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.082951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.084995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.099300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 609/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:43.105863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.192702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.234277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec679b-03d8-4536-8ed8-d43c77a29a62 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.282444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.283061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.283366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.283711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.292997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.294468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:43.308974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:43.309923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:43.310809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 608/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:43.316674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.440333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa007651-ffc3-4ff9-965f-54e33e561290 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.471352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.487848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.488535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.488856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.489142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.490975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.491289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.493031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fe5b-cbb7-4d44-9770-6557c75d2372 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.507581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 610/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:43.513654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.643036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ccd36-3dc5-4f50-9a87-091646d8cc28 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.676423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.683976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.684662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.684968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.685312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.686191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=ce69c247da4f47a3baaf1126891a70e9) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.686558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.688149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae78c3-46d1-42b4-b032-580dd7c5c764 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.703642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 609/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/role_assignments?user.id=ce69c247da4f47a3baaf1126891a70e9&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.007889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a027-0250-4ef8-a099-8d37bc2231d7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.008461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a027-0250-4ef8-a099-8d37bc2231d7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.008461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a027-0250-4ef8-a099-8d37bc2231d7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.010536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 611/1220] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:27:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:46.017254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.017728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.017831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.035334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:46.036597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:46.108375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 610/1221] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:46.132170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69a027-0250-4ef8-a099-8d37bc2231d7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.239117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69a027-0250-4ef8-a099-8d37bc2231d7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.278803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.279639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.279922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.280195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.290275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:46.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:46.299345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:46.300386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:46.305162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 612/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:46.306173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.423685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eda6f-3bd7-49c7-971a-a5aed82e5c77 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.450295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.462796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.463481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.463815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.464090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.464978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:46.465394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.467152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.475286 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 611/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.481389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.527577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.598828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c44d-ae4c-4bb0-9906-0ae443e8c65f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.637854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.638658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.638938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.639213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.651961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.653477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:46.670861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:46.671835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:46.673095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:46.673095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:46.673095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:46.673095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:46.673095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 613/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:46.678581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.786151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d86b0-4b50-4357-b9d3-bae78e73af26 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.825880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.826628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.826912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.827239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.828064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:46.828385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.829825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.843782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 612/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.849652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.953892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.962883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916696a-e918-48a0-ae82-d614c9233230 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.002627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.003442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.003828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.004106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.012799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.014423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:47.030596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:47.031923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:47.033033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 614/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:47.038472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.090099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.150516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7be0-c9b7-4509-a86f-774598872513 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.192221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.192957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.193770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.194078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.195260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.195670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.197243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.215129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 613/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:47.221551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.329014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2d8f9-e298-4762-9c72-2d8330963abc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.368138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.368998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.369276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.369546 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.381457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.383097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:47.402149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:47.403356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:47.404674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:47.404674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:47.404674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:47.404674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:47.404674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 615/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:47.409488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.519792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70f62-fa85-4716-bff8-8e1bba171a82 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.522846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.562693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.563484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.563943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.564250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.565021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.565415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.567151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.585962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 614/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:47.587304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.599505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.700065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b9f6-0d9a-488c-871c-08b52da5e245 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.737990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.738791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.739072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.739345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.746212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.747757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:47.762731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:47.764042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:47.765096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:47.767875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 616/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:47.770426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.886179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9bb9e-8715-4d8e-8557-aad345a13498 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.922585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.923302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.923609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.923884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.924769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.925090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.926655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd51a-9ffe-4956-9351-e923ab7bef71 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.946167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 615/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:47.947361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:48.022694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:48.058776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae492b8-b1f0-4d7d-ac85-283e9ce0d9fa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:48.102033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:48.102936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:48.103273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:48.103780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/ce69c247da4f47a3baaf1126891a70e9/roles/4a82e9530c83404ebe120804761d899b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:48.119479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=ce69c247da4f47a3baaf1126891a70e9, role_id=4a82e9530c83404ebe120804761d899b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:48.121490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c8113-ac77-4bee-8338-9095ac9badc7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:48.140404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 617/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:27:47 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/ce69c247da4f47a3baaf1126891a70e9/roles/4a82e9530c83404ebe120804761d899b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:27:50.548547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5650b-ad2e-43cb-9846-1538ad38d069 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.549209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5650b-ad2e-43cb-9846-1538ad38d069 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.549209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5650b-ad2e-43cb-9846-1538ad38d069 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.550751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 616/1233] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:50.557502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.557994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.558333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.579216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:50.580658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:50.656994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 618/1234] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:50.683226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5650b-ad2e-43cb-9846-1538ad38d069 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.710039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.801077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5650b-ad2e-43cb-9846-1538ad38d069 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.835238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.836063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.836337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.836603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.847679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:50.855929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:50.856994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:50.860398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 617/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:50.863568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.914064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.972071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93df49-2860-4bb5-9f3e-b2258a378d13 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.010215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.011597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.011597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.011597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.012383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.012695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.014209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.023708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 619/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.029893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.118821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.136314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bca5-a602-4e49-abed-1ccad3854085 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.174408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.175213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.175493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.175797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.187056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.188546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:51.207584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:51.209079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:51.210287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:51.210287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:51.210287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:51.210287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:51.212077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 618/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:51.218641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.325094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046f26-6819-4cdd-abaf-8e04ff4d2f8b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.335225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.363599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.364391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.364696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.365133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.365948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.366250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.367834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.382096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 620/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.390269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.515579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70440-7d1f-473a-8ec9-c90a1fb4c88c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.556818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.557788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.558196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.558534 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.562385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.568371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.570052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:51.587357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:51.588467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:51.597541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 619/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:51.598567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.706164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7798-b04d-4f0e-a1c9-a4fb6f113870 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.742003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541775-2893-4261-982e-438e7d9c045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.742710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541775-2893-4261-982e-438e7d9c045e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.742946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541775-2893-4261-982e-438e7d9c045e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.743226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541775-2893-4261-982e-438e7d9c045e None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.744328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39541775-2893-4261-982e-438e7d9c045e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.744798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39541775-2893-4261-982e-438e7d9c045e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.747076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39541775-2893-4261-982e-438e7d9c045e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.775607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 621/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.779808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.905139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190be07-956d-47d4-b586-807ce603f910 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.943152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.943879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.944177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.944479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:52.016292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:52.024281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:52.025989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.144607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 620/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:52.150850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541775-2893-4261-982e-438e7d9c045e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:52.186132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:52.277543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541775-2893-4261-982e-438e7d9c045e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:52.313062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:52.313922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:52.314240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:52.314511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:52.325754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:52.327490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:52.346308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:52.347402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:52.348323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:52.348323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:52.348323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:52.348323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:52.348323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 622/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:52.353750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:52.461325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:52.469323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dde8-b7cf-43f7-92e8-97cdbf20bf74 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:52.508354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:52.509021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:52.509298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:52.509565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:52.510284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:52.510581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:52.511991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.528352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 621/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:52.529438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:52.629847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:52.660535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b1e5-88dd-49e4-b373-98e21b1ea65a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:52.701020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:52.701964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:52.702252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:52.702560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:52.711029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:52.712677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:52.728721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:52.729988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:52.731208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 623/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:52.736833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:52.849602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee5ca-c162-4403-bd9e-80ab6c1ae92f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:52.884927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:52.885627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:52.885946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:52.886222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:52.887058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:52.887362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:52.888960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767d576-1957-45d6-9348-92c301f22692 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.901948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 622/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:52.908644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:53.027050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d3fd-0591-44c4-9a20-2ff1de3f4b6a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:53.064989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:53.065706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:53.065987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:53.066266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:53.067096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] RBAC: Adding query filter params (role.id=4a82e9530c83404ebe120804761d899b, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=ce69c247da4f47a3baaf1126891a70e9) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:53.067400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:53.068940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d101-b0d3-4273-9df7-99a3f9e0e2ba None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:53.074917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 624/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:27:52 2022] GET /identity/v3/role_assignments?user.id=ce69c247da4f47a3baaf1126891a70e9&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=4a82e9530c83404ebe120804761d899b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:55.498987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbcc6-94af-40ef-92e0-44a90a8ef160 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.499656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbcc6-94af-40ef-92e0-44a90a8ef160 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.499656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbcc6-94af-40ef-92e0-44a90a8ef160 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.500921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 623/1247] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:55.506246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.506738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.506848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.511890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.525586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:55.526785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:55.617547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 625/1248] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:55.643151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbcc6-94af-40ef-92e0-44a90a8ef160 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.663605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.760690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbcc6-94af-40ef-92e0-44a90a8ef160 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.803633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.804571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.804885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.805255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.818546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:55.827983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:55.828975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:55.830148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 624/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:55.835784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.949554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884aaa2b-2259-4e13-b220-62f5ca7b5c0b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.988181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.995144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.996018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.996626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.997050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.998094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:55.998472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.000532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.011707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 626/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:56.016602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.109602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:56.136136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c69f-4f0c-416d-ad16-d7dc632f7b91 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.177603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.178476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.178830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.179212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.192162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.194428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:56.215506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:56.216887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:56.217802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:56.217802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:56.217802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:56.217802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:56.217802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 625/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:56.223906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.339602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b62fc-3e5c-4121-8a84-98362b7dbaa8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.374266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.374934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.375209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.375479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.376226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:56.376527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.377917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.396531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 627/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:56.397801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.515232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce864-f96b-4a1c-b81e-301e5f24bc63 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.542831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:56.551662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.552669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.552984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.553265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.561805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.563401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:56.580177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:56.581227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:27:56.582616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 626/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:56.588101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.655480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:56.708312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711c8e-6a4f-40a0-8ccd-34d163977fb0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.750457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.751130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.751403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.751706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.752545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:56.752850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.754296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.772967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 628/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:56.778907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.889318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cc528-ac0b-4561-be49-6bf64d47fdb8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.930357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.930978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.931303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.931728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.995870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:57.009639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:57.011368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:57.121633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 627/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:57.127690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:57.236378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd631a-28f0-4936-8cc3-461a92c35fb1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:57.250478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:57.273359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:57.274301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:57.274603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:57.274879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:57.286896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:57.288694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:57.309107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:57.310587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:57.311630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:57.311630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:57.311630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:57.311630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:57.311630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 629/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:57.314986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:57.411205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:57.424480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036f3d9-4ca5-4424-b23a-1929c7d1692f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:57.463333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:57.464078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:57.464336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:57.464600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:57.465326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:57.465626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:57.467488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:57.480525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 628/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:57.487575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:57.604532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6df4-b9c8-455e-ab71-f1c5af979f99 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:57.647205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:57.648057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:57.648373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:57.649212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:57.656530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:57.658438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:57.674310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:57.675672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:27:57.676895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 630/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:57.682647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:57.792896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0d88-1837-4a8f-b471-429ffb0cfb77 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:57.830953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:57.831639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:57.831914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:57.832188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:57.833453 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:57.833760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:57.835242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cca36-0ae2-417f-9c87-ce6eb0afa221 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:57.848860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 629/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:57.855443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:57.884092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:57.966223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d6707-03d2-4bce-aa96-d4b05b1f2090 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:58.003850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:58.004513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.004801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.005104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.005937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=ce69c247da4f47a3baaf1126891a70e9) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:58.006247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:58.007762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154038f-3319-4f4b-bead-8bfdaf293320 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:58.014177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 631/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:27:57 2022] GET /identity/v3/role_assignments?user.id=ce69c247da4f47a3baaf1126891a70e9&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:00.180307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdfa11-e6b4-4b0f-8f58-9986b72a9e3a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.180834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdfa11-e6b4-4b0f-8f58-9986b72a9e3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.180834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdfa11-e6b4-4b0f-8f58-9986b72a9e3a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.182287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 630/1261] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:00.187526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.187962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.188105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.205210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:00.206403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:00.282996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 632/1262] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:00.305931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdfa11-e6b4-4b0f-8f58-9986b72a9e3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:00.317584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:00.409061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdfa11-e6b4-4b0f-8f58-9986b72a9e3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:00.448353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:00.449143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.449419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.449687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.460556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:28:00.468462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:00.469500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:28:00.470592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:00.471715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 631/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:00.476189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:00.494689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:00.586740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5c89-2747-418a-8b01-32f8802607e5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:00.626231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:00.627021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.627322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.627607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.628468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:00.628839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:00.630609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:00.638780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 633/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:00.645860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:00.717712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:00.753864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bbf63-8b12-4dba-ad8a-ba3f66a184d1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:00.788178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:00.788979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.789262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.789518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.800112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:00.801803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:28:00.818722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:00.819757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:00.820840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:28:00.820840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:28:00.820840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:00.820840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:00.820840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 632/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:00.825910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:00.911594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:00.934271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d678be-6c61-481b-b32b-31c3abe06cda None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:00.970783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:00.971356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:00.971680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:00.971934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:00.972651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:00.972950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:00.974516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:00.986205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 634/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:00.994403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.112172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8fd8-8c99-4a73-93a9-7535c6040a62 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.132056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:01.147369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.148198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.148473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.148729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.156164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.157618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:28:01.171918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:01.172968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:01.175752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 633/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:01.180122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.279088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a66a7-40eb-4fc1-8b8b-655a5dd872da None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.314242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.314895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.315174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.315444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.316308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:01.316613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.318138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.326611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:01.335172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 635/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:01.341507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.445599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050f696-1a85-4882-b73d-4919da5a00c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.486104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.486905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.487192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.487442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.498548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.500041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:28:01.517306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:01.518288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:01.519308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:28:01.519308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:28:01.519308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:01.519308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:01.519308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 634/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:01.524560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.638796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c439f1d-3da6-427b-a720-28d8d4dd769a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.673808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.674454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.674729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.674996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.675740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:01.676032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.677608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.688848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 636/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:01.695478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.734901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:01.812634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f84b-0d5a-4c29-a551-362daf6c6b8c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.853503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.854297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.854575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.854845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.862084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.863567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:28:01.878434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:01.879492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:01.881309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 635/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:01.885834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.950443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:02.002780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58cea-9e5e-43f4-9150-77fce0cc049d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:02.038737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:02.039378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:02.039689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:02.039961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:02.040737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:02.041030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:02.042467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d75b3-8a70-4989-8648-1d2489cddb70 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:02.057220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 637/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:02.066598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:02.160020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:02.168987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c290-aa0c-4439-a2a6-7152dd10cd03 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:02.213766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:02.214579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:02.214860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:02.215131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] PATH_INFO: `/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/ce69c247da4f47a3baaf1126891a70e9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:02.217561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf78e40dc914e49a59f8c8fd372a5c3, user_id=ce69c247da4f47a3baaf1126891a70e9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:02.218996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8ad3a-5108-4367-86ef-b4d1ebbf7640 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:02.237828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 636/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 26 12:28:02 2022] PUT /identity/v3/projects/bcf78e40dc914e49a59f8c8fd372a5c3/users/ce69c247da4f47a3baaf1126891a70e9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:28:04.369209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39893a7-e9dd-4e3a-bf24-b1ef6eef7d16 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.369924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39893a7-e9dd-4e3a-bf24-b1ef6eef7d16 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.369924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39893a7-e9dd-4e3a-bf24-b1ef6eef7d16 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.372106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 638/1274] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:04.378946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.379819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.379819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.405544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:04.407379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:04.481939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 637/1275] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:04.505626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39893a7-e9dd-4e3a-bf24-b1ef6eef7d16 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.633383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39893a7-e9dd-4e3a-bf24-b1ef6eef7d16 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.653527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:04.670623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.671428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.671738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.672018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.683164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:28:04.690715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:04.691920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:28:04.692769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:04.695768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 639/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:04.698929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.785942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:04.812512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841756e-deda-41e3-af82-8a3b3b4f79bb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.850584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.851246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.851527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.851830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.852586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:04.852895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:04.854284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:04.862794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 638/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:04.868819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.985582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda827-56cc-4868-a445-0610c2e807f9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.021375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.022171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.022450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.022725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.033556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.035035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:28:05.052622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:05.053720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:05.054782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:28:05.054782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:28:05.054782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:05.054782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:05.054782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 640/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:05.059975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:05.170662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1386-5c06-46ac-9cfa-7775eb02e91a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.206098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.206747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.207030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.207431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.208331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:05.208634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.210010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.224840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 639/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:05.230804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:05.265111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:05.357551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f260d0-3a6d-46e3-abb0-1f0c67f02607 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.393337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.394131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.394414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.394725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.402317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.403830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:28:05.417916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:05.418979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:05.424678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 641/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:05.426932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:05.431065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:05.557013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a991-806c-4d60-9622-2a260407c17c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.598958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.599656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.599939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.600216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.601060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:05.601367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.602817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.620100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 640/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:05.626199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:05.724805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:05.742428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a23b1-7e50-4c6a-973a-d554a7b7e6ad None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.786600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.787715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.787715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.787881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.871477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.873615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.970511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:05.983859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 642/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:28:05.990378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.053262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:06.103527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31783710-57f8-4dff-bc43-c300c3fc7df0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:06.143234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:06.143971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.144245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.144511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.158276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:06.160621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:28:06.187400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:06.188462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:06.189692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:28:06.189692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:28:06.189692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:28:06.189692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:06.189692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 641/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:06.194916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.303384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9409-c4c2-4823-9b2c-d0c492ea6fdf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:06.341985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:06.342626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.342902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.343165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.343909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:06.344209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:06.345580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:06.357824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 643/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 26 12:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:06.364808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.477131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb982eb-7759-4e79-84f8-0d8c0bb82d7d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:06.491596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:06.534929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:06.535973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.536244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.536510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.544471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:06.545992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:28:06.561555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:06.567610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application May 26 12:28:06.568802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 642/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 26 12:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:06.570203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.622989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:06.678683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804bddd-cea3-415b-871c-354c68752132 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:06.712955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:06.713606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.713894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.714159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.715280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:06.715629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:06.717064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d257235-c0d8-4bb5-9628-04453e0610e9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:06.730603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 644/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 26 12:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:06.739672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.845418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec376-404e-44a9-ac8b-c89e0a6aeeeb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:06.880070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:06.880714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.880987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.881252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.882080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] RBAC: Adding query filter params (role.id=9ea7741ab45842faa0bb474f4ee06ed4, scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3, user.id=ce69c247da4f47a3baaf1126891a70e9) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:06.882378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:06.883833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254213b4-a726-4ce3-91d3-e12fda6f1b26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:06.889821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 643/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 26 12:28:06 2022] GET /identity/v3/role_assignments?user.id=ce69c247da4f47a3baaf1126891a70e9&scope.project.id=bcf78e40dc914e49a59f8c8fd372a5c3&role.id=9ea7741ab45842faa0bb474f4ee06ed4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:09.093864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0e3b-314e-4967-9f2f-577bd67dfa2f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:09.094414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0e3b-314e-4967-9f2f-577bd67dfa2f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:09.094414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0e3b-314e-4967-9f2f-577bd67dfa2f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:09.095727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 645/1288] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:09.102089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:09.102778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:09.102911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:09.125346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:09.126527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:09.158707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:09.196910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 644/1289] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:09.220004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0e3b-314e-4967-9f2f-577bd67dfa2f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:09.328655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0e3b-314e-4967-9f2f-577bd67dfa2f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:09.339210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:09.364570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:09.365290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:09.365569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:09.365837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:09.366491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:09.367920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:09.380090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:09.381253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:09.383075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 646/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:28:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:09.390393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:09.495505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b26cf-581a-45af-9ad2-861fcbbb85e7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:09.536905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:09.537550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:09.537830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:09.538094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:09.538800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:09.539103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:09.540495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52070a-4498-4ad5-823f-c8d97be99912 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:09.545267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 645/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 26 12:28:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:09.552397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:09.677043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a06-d94a-4586-9708-76a133041418 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:09.712315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:09.712966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:09.713246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:09.713514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:09.714221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:09.714528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:09.716329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b5cb-4cd3-418b-ab4d-26e8cfad8a39 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:09.721025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 647/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 26 12:28:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:11.884665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3752-6b8a-4155-8dea-4761c7324104 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:11.885234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3752-6b8a-4155-8dea-4761c7324104 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:11.885234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3752-6b8a-4155-8dea-4761c7324104 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:11.887375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 646/1293] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:11.896260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501998b-eea5-4fc2-be78-4cec143f053d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:11.896666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501998b-eea5-4fc2-be78-4cec143f053d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:11.896922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501998b-eea5-4fc2-be78-4cec143f053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:11.916455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3501998b-eea5-4fc2-be78-4cec143f053d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:11.917644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3501998b-eea5-4fc2-be78-4cec143f053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:11.951349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:11.992295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 648/1294] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:12.025409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d3752-6b8a-4155-8dea-4761c7324104 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:12.061919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:12.152947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d3752-6b8a-4155-8dea-4761c7324104 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:12.186840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:12.187487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:12.187794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:12.188065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:12.188781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:12.190150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb5c9e-030d-4fc5-8961-d5a748c4821e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:12.209513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 647/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 26 12:28:12 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:28:14.378000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832055e-edae-4194-be2b-08a30546f4d8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:14.378613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832055e-edae-4194-be2b-08a30546f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:14.378613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832055e-edae-4194-be2b-08a30546f4d8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:14.380685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 649/1296] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:14.388693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:14.389144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:14.389267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:14.407988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:14.409160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:14.485067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 648/1297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:28:14.521863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832055e-edae-4194-be2b-08a30546f4d8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:14.636794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832055e-edae-4194-be2b-08a30546f4d8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:14.670250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:14.671033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:14.671307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:14.671574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:14.672240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:14.673621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:14.685725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:14.686858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:14.687914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 650/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:28:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:14.694644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:14.724502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:14.816716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2103dd-b169-4563-9901-ab379dfea516 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:14.853964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:14.854619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:14.854900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:14.855177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:14.855916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:14.856218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:14.857595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:14.862927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 649/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 26 12:28:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:14.869310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:14.905689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:14.981070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e0231-9529-4efb-9d83-575b5c56f66a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:15.015748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:15.016393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:15.016669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:15.016935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:15.017714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] RBAC: Adding query filter params (interface=public, service_id=22e9027a9a524e23bbb93d3a2913b1e6, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:15.018018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:15.019487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56831e58-6108-47a6-81ea-1be4c50d9ebd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:15.024727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 651/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 26 12:28:14 2022] GET /identity/v3/endpoints?service_id=22e9027a9a524e23bbb93d3a2913b1e6&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:15.030732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:15.120084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:15.140081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce15089-381d-4e3e-841d-23962f8d720f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:15.177685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:15.178280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:15.178562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:15.178831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:15.179520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:15.180922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e88cfe-ab4a-45b5-b766-6c88bf89b249 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:15.187976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 650/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 26 12:28:15 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:28:17.369887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534a77-dfaf-4223-90f1-1ea38cb98523 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:17.370462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534a77-dfaf-4223-90f1-1ea38cb98523 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:17.370462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534a77-dfaf-4223-90f1-1ea38cb98523 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:17.371860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 652/1302] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:17.378318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:17.379012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:17.379504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:17.403073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:17.404281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:17.474032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 651/1303] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:28:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:17.501988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd534a77-dfaf-4223-90f1-1ea38cb98523 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:17.605571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:17.618166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd534a77-dfaf-4223-90f1-1ea38cb98523 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:17.657899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:17.658621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:17.658896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:17.659221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:17.659904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:17.661290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:17.673595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:17.674707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: ERROR keystone.server.flask.application May 26 12:28:17.675582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 653/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 26 12:28:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:17.683020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:17.761898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:17.788181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1eea-cce2-4d9e-bf43-52718e36f632 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:17.825411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:17.826074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:17.826353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:17.826626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:17.827335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:17.827669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:17.829069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09c26-0d01-4e17-8a49-9d5ec1c9d14d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:17.834572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 652/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 26 12:28:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:28:17.840898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:17.958860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e13e-72ad-460e-9ede-a03b239edeb0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:17.994649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:17.995295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:17.995578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:17.995884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:17.996621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:17.998180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9d99-7f61-4fd4-80c7-c82bc69cd9e7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:18.021698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 654/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 26 12:28:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:28:27.831198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=30 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:28.015450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:21.643491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7685c-60c8-4fb1-82ab-392c88941d60 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.644086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7685c-60c8-4fb1-82ab-392c88941d60 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.644086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7685c-60c8-4fb1-82ab-392c88941d60 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.650742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da28bd-5b16-4100-a0aa-b19c2392b1eb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.651204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da28bd-5b16-4100-a0aa-b19c2392b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.651289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da28bd-5b16-4100-a0aa-b19c2392b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.655210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 653/1307] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:21.725319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-62da28bd-5b16-4100-a0aa-b19c2392b1eb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:21.726534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-62da28bd-5b16-4100-a0aa-b19c2392b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:21.933699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 655/1308] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:29:21.962871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.963168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.963442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.965129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 654/1309] 10.222.0.75 () {54 vars in 964 bytes} [Thu May 26 12:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:21.977046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844b5d-a0de-4f8c-8c8a-0ab52be7bb66 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.977775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844b5d-a0de-4f8c-8c8a-0ab52be7bb66 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.978282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844b5d-a0de-4f8c-8c8a-0ab52be7bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.100751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ba844b5d-a0de-4f8c-8c8a-0ab52be7bb66 None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:22.102090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ba844b5d-a0de-4f8c-8c8a-0ab52be7bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:22.131929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.186677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 656/1310] 10.222.0.75 () {58 vars in 1061 bytes} [Thu May 26 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:22.195602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.197452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:22.338506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bde8-54b1-406e-b275-fd200f7339d3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.416693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.417475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.417818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.418178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.419993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:22.480247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.539278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.541341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b078da-3de5-4659-97a0-6092c3e55bc7 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.561560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 655/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:25.065087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661bfa2-20c5-4b04-9398-b8daf8e9cb7c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.065631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661bfa2-20c5-4b04-9398-b8daf8e9cb7c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.065631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661bfa2-20c5-4b04-9398-b8daf8e9cb7c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.071804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 657/1312] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:25.073403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680d19-b1ec-490b-8bf7-af9de9f233c4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.073897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680d19-b1ec-490b-8bf7-af9de9f233c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.073980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680d19-b1ec-490b-8bf7-af9de9f233c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.171588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-df680d19-b1ec-490b-8bf7-af9de9f233c4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:25.173000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-df680d19-b1ec-490b-8bf7-af9de9f233c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:25.294689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 656/1313] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:29:25.344839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.345356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.345717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.347287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 658/1314] 10.222.0.75 () {54 vars in 964 bytes} [Thu May 26 12:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:25.353089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09a02-4857-43f4-a9b6-9fd8a91e8ba4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.353385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09a02-4857-43f4-a9b6-9fd8a91e8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.353664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09a02-4857-43f4-a9b6-9fd8a91e8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.364466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:25.443718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-65c09a02-4857-43f4-a9b6-9fd8a91e8ba4 None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:25.445236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65c09a02-4857-43f4-a9b6-9fd8a91e8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:25.538315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 657/1315] 10.222.0.75 () {58 vars in 1061 bytes} [Thu May 26 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:25.547334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:25.548812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:25.665836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c9c81-3e63-4075-a4be-7ed3b5191111 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:25.752436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:25.755491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:25.756292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.756704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.757264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.759942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:25.902930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:25.904434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c79a9-4321-44f9-9091-fe83892970e9 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:25.923578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 659/1316] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:28.641073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:28.641990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:28.641990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:28.644285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 658/1317] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:28.650552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb975cb-f112-47ab-b133-5fd19ea605c0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:28.651253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb975cb-f112-47ab-b133-5fd19ea605c0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:28.651398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb975cb-f112-47ab-b133-5fd19ea605c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:28.717430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8bb975cb-f112-47ab-b133-5fd19ea605c0 None None] MFA Rules not processed for user `650134ee12184024a2141ce2785d0e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:28.718641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8bb975cb-f112-47ab-b133-5fd19ea605c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:28.786096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:28.835678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 660/1318] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:28.877349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:28.879779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:28.988984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810a01-7c18-4813-9605-da43679bd5a6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:28.991893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:29.069450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:29.070093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:29.070374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:29.070641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:29.072309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:29.188730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:29.190168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac7126-6f81-4e47-aa61-dd2bc38d9fa2 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:29.211300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 659/1319] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:31.966891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:31.967489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:31.967489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:31.968844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 661/1320] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:31.975285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b184-c973-4bdf-ba75-b15378e5af7d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:31.976028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b184-c973-4bdf-ba75-b15378e5af7d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:31.976216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b184-c973-4bdf-ba75-b15378e5af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:32.024667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:32.053724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-aca1b184-c973-4bdf-ba75-b15378e5af7d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:32.054862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aca1b184-c973-4bdf-ba75-b15378e5af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:32.177670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 660/1321] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:32.225837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:32.227386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:32.344138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1217-731b-4262-813e-5aacb497d583 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:32.421389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:32.422027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:32.422303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:32.422576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:32.424252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:32.432132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:32.549849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:32.551303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a6244-707a-4d52-947d-86f4ec441366 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:32.572745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 662/1322] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:35.451984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:35.452564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:35.452564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:35.453963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 661/1323] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:35.460074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e9d6-b632-4c38-b1f3-65ef5b86e30e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:35.460481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e9d6-b632-4c38-b1f3-65ef5b86e30e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:35.460618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e9d6-b632-4c38-b1f3-65ef5b86e30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:35.527009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6cb9e9d6-b632-4c38-b1f3-65ef5b86e30e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:35.528669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6cb9e9d6-b632-4c38-b1f3-65ef5b86e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:35.589214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:35.630444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 663/1324] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:35.665817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:35.667349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:35.771898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf658ef0-6ca3-490b-a060-cd911dc1b53e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:35.784586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:35.848512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:35.849156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:35.849435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:35.849676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:35.851323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:35.964464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:35.966066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe94e82-f7a1-4728-ad2e-27b308c43867 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:35.984498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 662/1325] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:38.223905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:38.224527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:38.224527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:38.225787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 664/1326] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:38.231168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aaacb-d99e-49ec-bc3c-b588d1b175bc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:38.231670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aaacb-d99e-49ec-bc3c-b588d1b175bc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:38.231901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aaacb-d99e-49ec-bc3c-b588d1b175bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:38.284262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:38.303846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d01aaacb-d99e-49ec-bc3c-b588d1b175bc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:38.313298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d01aaacb-d99e-49ec-bc3c-b588d1b175bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:38.408126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 663/1327] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:38.443349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:38.445012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:38.554111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c34ee-a75c-414a-8fc0-87c0876de8d7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:38.631984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:38.632642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:38.632923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:38.633195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:38.634887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:38.652407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:38.751268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:38.752882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5de8-3614-46b5-8bba-e146362a4683 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:38.773926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 665/1328] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:41.066154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:41.066675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:41.066675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:41.068113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 664/1329] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:41.073415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822782a-63f0-436e-8ebd-4a8b04f18b39 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:41.073867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822782a-63f0-436e-8ebd-4a8b04f18b39 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:41.073954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822782a-63f0-436e-8ebd-4a8b04f18b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:41.150820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5822782a-63f0-436e-8ebd-4a8b04f18b39 None None] MFA Rules not processed for user `650134ee12184024a2141ce2785d0e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:41.152600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5822782a-63f0-436e-8ebd-4a8b04f18b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:41.228180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:41.262172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 666/1330] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:41.300566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:41.302115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:41.411717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4f76a-dab0-4eea-b839-41f8b4693d34 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:41.431956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:41.486965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:41.487649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:41.487930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:41.488191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:41.489902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:41.601229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:41.602698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb07e8-abbf-431d-928f-0780a420d505 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:41.621451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 665/1331] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:44.223834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:44.224466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:44.224466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:44.226590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 667/1332] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:44.232951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adec9-a41d-463a-aac7-e00fdc497af7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:44.233655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adec9-a41d-463a-aac7-e00fdc497af7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:44.233751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adec9-a41d-463a-aac7-e00fdc497af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:44.302359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:44.306016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-990adec9-a41d-463a-aac7-e00fdc497af7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:44.307775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-990adec9-a41d-463a-aac7-e00fdc497af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:44.408360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 666/1333] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:44.443657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:44.445195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:44.558990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e255551-b5ad-400f-8380-e9d547527998 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:44.638122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:44.638776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:44.639061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:44.639333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:44.641047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:44.668518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:44.754862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:44.756371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35eccc-53e2-40a5-991c-2b78db555b17 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:44.776014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 668/1334] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:47.009438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:47.010352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:47.010352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:47.012454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 667/1335] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:47.018101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1539-a1a5-4eb4-af37-ba45c67a09c2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:47.018542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1539-a1a5-4eb4-af37-ba45c67a09c2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:47.018634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1539-a1a5-4eb4-af37-ba45c67a09c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:47.084381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-50dc1539-a1a5-4eb4-af37-ba45c67a09c2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:47.085559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-50dc1539-a1a5-4eb4-af37-ba45c67a09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:47.174364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:47.198124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 669/1336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:47.241076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:47.243513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:47.359343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1707-1c4c-4838-8134-706bee876512 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:47.388057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:47.435910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:47.436554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:47.436832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:47.437102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:47.438738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:47.553789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:47.555250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3f1e-c1d2-4e21-8baf-48842ca2d13b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:47.574396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 668/1337] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:50.300697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:50.301339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:50.301339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:50.302622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 670/1338] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:50.308482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178d8-e415-4eda-86de-5c0c4b4e1266 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:50.308925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178d8-e415-4eda-86de-5c0c4b4e1266 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:50.309039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178d8-e415-4eda-86de-5c0c4b4e1266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:50.375121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d22178d8-e415-4eda-86de-5c0c4b4e1266 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:50.376345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d22178d8-e415-4eda-86de-5c0c4b4e1266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:50.384875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:50.477977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 669/1339] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:50.516801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:50.519236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:50.642896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb4288-fcb8-452c-9435-ba8e77af7020 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:50.721994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:50.722630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:50.722910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:50.723181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:50.724848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:50.761454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:50.846785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:50.848282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b87a-f2e1-479a-8064-adf1ed420c01 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:50.867224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 671/1340] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:55.245902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:55.246511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:55.246511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:55.247806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 670/1341] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:55.253125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a029a-cc5d-4fe1-81ea-738c39cc61b4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:55.253572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a029a-cc5d-4fe1-81ea-738c39cc61b4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:55.253679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a029a-cc5d-4fe1-81ea-738c39cc61b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:55.326754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e04a029a-cc5d-4fe1-81ea-738c39cc61b4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:55.327994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e04a029a-cc5d-4fe1-81ea-738c39cc61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:55.423856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:55.438496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 672/1342] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:55.476994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:55.479594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:55.583586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3aecc-15fd-45da-99fc-6c0369a45deb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:55.587205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:55.587893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:55.588174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:55.588667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:55.597908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:55.599342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1550477-ee20-48de-bfcc-66e729c44d1c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:55.609098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 671/1343] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:58.415331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9146b-d4f1-4570-99c7-ae7020b0d2dd None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:58.415899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9146b-d4f1-4570-99c7-ae7020b0d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:58.415899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9146b-d4f1-4570-99c7-ae7020b0d2dd None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:58.417216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 673/1344] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:58.422549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540a64-cd11-4b9e-b68a-e4ead128041a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:58.423027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540a64-cd11-4b9e-b68a-e4ead128041a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:58.423130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540a64-cd11-4b9e-b68a-e4ead128041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:58.453380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b0540a64-cd11-4b9e-b68a-e4ead128041a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:58.454570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0540a64-cd11-4b9e-b68a-e4ead128041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:58.485254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:58.537112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 672/1345] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:29:58.577161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9146b-d4f1-4570-99c7-ae7020b0d2dd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:58.589687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9146b-d4f1-4570-99c7-ae7020b0d2dd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:58.593670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:58.594308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:58.594578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:58.594842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:58.604994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:58.606453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35faa-fe41-4218-965f-de80d4ee301f service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:58.616328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 674/1346] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:03.010965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe1fb-6c73-4caf-ade9-0f799c79abd1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:03.011490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe1fb-6c73-4caf-ade9-0f799c79abd1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:03.011490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe1fb-6c73-4caf-ade9-0f799c79abd1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:03.012863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 673/1347] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:03.018187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc1af-402a-4807-97b2-169471ec7511 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:03.018623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc1af-402a-4807-97b2-169471ec7511 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:03.018717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc1af-402a-4807-97b2-169471ec7511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:03.038578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-966fc1af-402a-4807-97b2-169471ec7511 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:03.039783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-966fc1af-402a-4807-97b2-169471ec7511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:03.048399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 675/1348] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:03.086410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe1fb-6c73-4caf-ade9-0f799c79abd1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:03.098211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe1fb-6c73-4caf-ade9-0f799c79abd1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:03.102809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:03.103567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:03.104083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:03.104579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:03.113775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:03.115220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41510-f0fb-47e3-9fed-6438cd060fc6 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:03.124811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 674/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:08.615986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2d50-60d4-4661-bb3a-4175eadaf098 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:08.616867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2d50-60d4-4661-bb3a-4175eadaf098 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:08.617289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2d50-60d4-4661-bb3a-4175eadaf098 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:08.619220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 676/1350] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:08.624439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df507-2c3d-43d1-8c50-7ea65af3946a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:08.625266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df507-2c3d-43d1-8c50-7ea65af3946a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:08.625736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df507-2c3d-43d1-8c50-7ea65af3946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:08.701589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fb2df507-2c3d-43d1-8c50-7ea65af3946a None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:08.703096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fb2df507-2c3d-43d1-8c50-7ea65af3946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:08.782933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 675/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:13.033121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=13 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:13.786248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472a307-8ecc-4ed4-9444-efd79c8b958e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:13.787343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472a307-8ecc-4ed4-9444-efd79c8b958e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:13.788157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472a307-8ecc-4ed4-9444-efd79c8b958e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:13.791473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 677/1352] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:30:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:13.797048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe3e4-ca5c-4989-bcde-5216317facd6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:13.797540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe3e4-ca5c-4989-bcde-5216317facd6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:13.797777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe3e4-ca5c-4989-bcde-5216317facd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:13.816675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a1cbe3e4-ca5c-4989-bcde-5216317facd6 None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:13.818007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a1cbe3e4-ca5c-4989-bcde-5216317facd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:13.828027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 676/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:15.226583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643682a3-b03f-414b-84d6-438b0cffcc28 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:15.227152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643682a3-b03f-414b-84d6-438b0cffcc28 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:15.227152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643682a3-b03f-414b-84d6-438b0cffcc28 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:15.228923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 678/1354] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:15.233698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9795d9-cb8b-46b9-8c43-2182258b100d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:15.234155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9795d9-cb8b-46b9-8c43-2182258b100d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:15.234371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9795d9-cb8b-46b9-8c43-2182258b100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:15.253025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ab9795d9-cb8b-46b9-8c43-2182258b100d None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:15.254306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab9795d9-cb8b-46b9-8c43-2182258b100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:15.263135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 677/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:18.686350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b803-9816-4231-9040-7e9e2182d5c9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.686882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b803-9816-4231-9040-7e9e2182d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.686882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b803-9816-4231-9040-7e9e2182d5c9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.688123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 679/1356] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:18.693783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44a91-bcf7-4036-bc86-8ad0ea6ea0b5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.694204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44a91-bcf7-4036-bc86-8ad0ea6ea0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.694331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44a91-bcf7-4036-bc86-8ad0ea6ea0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.713473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ccf44a91-bcf7-4036-bc86-8ad0ea6ea0b5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:18.714672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ccf44a91-bcf7-4036-bc86-8ad0ea6ea0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:18.723215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 678/1357] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:18.779820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec90a0-35b9-468a-93ea-6d4af46852f2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.780438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec90a0-35b9-468a-93ea-6d4af46852f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.780936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec90a0-35b9-468a-93ea-6d4af46852f2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.783388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 680/1358] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 26 12:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:18.797147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51983d4-620f-4d56-b8a7-14e1c909bd19 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.797431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51983d4-620f-4d56-b8a7-14e1c909bd19 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.798212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51983d4-620f-4d56-b8a7-14e1c909bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.868420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:18.876904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f51983d4-620f-4d56-b8a7-14e1c909bd19 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:18.878195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f51983d4-620f-4d56-b8a7-14e1c909bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:18.963235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 679/1359] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 26 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:18.971261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec90a0-35b9-468a-93ea-6d4af46852f2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:18.985851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec90a0-35b9-468a-93ea-6d4af46852f2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:18.991184 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:18.991860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.992137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.992662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:19.003276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:19.005708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738a5f9-95e1-40cb-bc29-349f552e3249 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:19.017128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 681/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:21.456374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1465fa-d624-4563-aef4-e0d0cfc55695 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:21.456923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1465fa-d624-4563-aef4-e0d0cfc55695 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:21.456923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1465fa-d624-4563-aef4-e0d0cfc55695 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:21.458397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 680/1361] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:21.463805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f27d-b9d9-4a41-a2b9-39261c4d629b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:21.464256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f27d-b9d9-4a41-a2b9-39261c4d629b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:21.464348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f27d-b9d9-4a41-a2b9-39261c4d629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:21.482937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5c48f27d-b9d9-4a41-a2b9-39261c4d629b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:21.484141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5c48f27d-b9d9-4a41-a2b9-39261c4d629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:21.492134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 682/1362] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:21.537474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1465fa-d624-4563-aef4-e0d0cfc55695 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:21.556060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1465fa-d624-4563-aef4-e0d0cfc55695 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:21.561956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:21.562747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:21.563054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:21.563550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:21.573484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:21.575096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7c53-7fc8-405c-a9cd-91626620293c service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:21.585526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 681/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:24.111781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7101b-2e1b-4960-9e06-c509147fefc7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:24.112351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7101b-2e1b-4960-9e06-c509147fefc7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:24.112461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7101b-2e1b-4960-9e06-c509147fefc7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:24.113802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 683/1364] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:24.119719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc286d5-20a4-4993-a613-3fde55492efb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:24.120184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc286d5-20a4-4993-a613-3fde55492efb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:24.120296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc286d5-20a4-4993-a613-3fde55492efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:24.141473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6bc286d5-20a4-4993-a613-3fde55492efb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:24.143135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6bc286d5-20a4-4993-a613-3fde55492efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:24.152585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 682/1365] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:24.199378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86fca-26b2-4a46-b99a-4c7e0f887048 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:24.199679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86fca-26b2-4a46-b99a-4c7e0f887048 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:24.199950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86fca-26b2-4a46-b99a-4c7e0f887048 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:24.201820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 684/1366] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 26 12:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:30:24.213536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee55df-b75f-4e96-bb7e-90d21876f7cd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:24.214168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee55df-b75f-4e96-bb7e-90d21876f7cd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:24.214578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee55df-b75f-4e96-bb7e-90d21876f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:24.240092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f6ee55df-b75f-4e96-bb7e-90d21876f7cd None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:24.241541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6ee55df-b75f-4e96-bb7e-90d21876f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:24.269321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 683/1367] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 26 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:24.283238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b86fca-26b2-4a46-b99a-4c7e0f887048 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:24.297806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b86fca-26b2-4a46-b99a-4c7e0f887048 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:24.303132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:24.303814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:24.304092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:24.304358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:24.312877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:24.314490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276d1a-8826-4801-a31e-674a2eb9b2be service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:24.324517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 685/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:30:26.602973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fa9d-63ea-44a2-b288-5a4f92313d6b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:26.603629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fa9d-63ea-44a2-b288-5a4f92313d6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:26.603629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fa9d-63ea-44a2-b288-5a4f92313d6b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:26.604913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 684/1369] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:26.610436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7010-5214-4e8b-a94d-fb043ebb8474 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:26.611245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7010-5214-4e8b-a94d-fb043ebb8474 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:26.611736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7010-5214-4e8b-a94d-fb043ebb8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:26.632607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-84ae7010-5214-4e8b-a94d-fb043ebb8474 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:26.636240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-84ae7010-5214-4e8b-a94d-fb043ebb8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:26.645340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 686/1370] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:26.689693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3fa9d-63ea-44a2-b288-5a4f92313d6b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:26.705229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3fa9d-63ea-44a2-b288-5a4f92313d6b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:26.710983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:26.711876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:26.712309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:26.712724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:26.721835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:26.723658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e06b9-8453-4e00-84b8-7d3e468bbfcb service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:26.734438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 685/1371] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:27.066419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc334-27f8-407f-a237-bae854b877c8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:27.067181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc334-27f8-407f-a237-bae854b877c8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:27.067886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc334-27f8-407f-a237-bae854b877c8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:27.070010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 687/1372] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:30:27.077852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd44f-bcd1-4a21-8ac5-81017e0702a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:27.078156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd44f-bcd1-4a21-8ac5-81017e0702a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:27.078628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd44f-bcd1-4a21-8ac5-81017e0702a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:27.100684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5b1dd44f-bcd1-4a21-8ac5-81017e0702a7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:27.101922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b1dd44f-bcd1-4a21-8ac5-81017e0702a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:27.110098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 686/1373] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:27.423290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c8ef-6526-4427-97ef-9c505b83b9c0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:27.423880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c8ef-6526-4427-97ef-9c505b83b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:27.424943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c8ef-6526-4427-97ef-9c505b83b9c0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:27.426318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 688/1374] 10.222.0.75 () {54 vars in 963 bytes} [Thu May 26 12:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:27.434483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66411-e554-4298-9840-b48b65307049 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:27.435108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66411-e554-4298-9840-b48b65307049 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:27.435486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66411-e554-4298-9840-b48b65307049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:27.495305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ddf66411-e554-4298-9840-b48b65307049 None None] MFA Rules not processed for user `7df29f2915c446f5b3c0ed3cfb14a89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:27.497899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ddf66411-e554-4298-9840-b48b65307049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:27.586891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 687/1375] 10.222.0.75 () {58 vars in 1060 bytes} [Thu May 26 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:27.604249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06c8ef-6526-4427-97ef-9c505b83b9c0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:27.627232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06c8ef-6526-4427-97ef-9c505b83b9c0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:27.632761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:27.633732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:27.634224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:27.634766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:27.647459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:27.649943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb33a-5c4d-4a8e-b8b2-619f0df396e7 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:27.661823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 689/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:29.057318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f0d1-28c7-4cc2-b97d-06fb0c13ee0f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:29.057845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f0d1-28c7-4cc2-b97d-06fb0c13ee0f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:29.057845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f0d1-28c7-4cc2-b97d-06fb0c13ee0f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:29.059200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 688/1377] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:29.064757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54280-444b-4fc8-a596-f86564208d70 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:29.065540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54280-444b-4fc8-a596-f86564208d70 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:29.065815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54280-444b-4fc8-a596-f86564208d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:29.084649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f4e54280-444b-4fc8-a596-f86564208d70 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:29.086082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4e54280-444b-4fc8-a596-f86564208d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:29.094493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 690/1378] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:29.139976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f0d1-28c7-4cc2-b97d-06fb0c13ee0f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:29.155684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f0d1-28c7-4cc2-b97d-06fb0c13ee0f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:29.161403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:29.162055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:29.162334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:29.162607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:29.171923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:29.173502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7627c-ac37-4be8-a8bb-508c692d9cc4 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:29.177457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:29.193569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 689/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:31.505045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9534c-dd24-4ff6-bca5-43a440cfa1e7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.505476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9534c-dd24-4ff6-bca5-43a440cfa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.505604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9534c-dd24-4ff6-bca5-43a440cfa1e7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.507044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 691/1380] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:31.513610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769f0a-eac1-4962-9d1e-a30c28f3b673 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.513610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769f0a-eac1-4962-9d1e-a30c28f3b673 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.513610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769f0a-eac1-4962-9d1e-a30c28f3b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.537346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-44769f0a-eac1-4962-9d1e-a30c28f3b673 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:31.538780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-44769f0a-eac1-4962-9d1e-a30c28f3b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:31.548060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 690/1381] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:31.600021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9534c-dd24-4ff6-bca5-43a440cfa1e7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:31.628300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9534c-dd24-4ff6-bca5-43a440cfa1e7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:31.635093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:31.636297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.636777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.637372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.649171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:31.651144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0650f-91ae-4e35-afe4-03c386322481 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:31.664241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 692/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:33.937757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507643-4756-4705-a1de-07356e50a620 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:33.938789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507643-4756-4705-a1de-07356e50a620 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:33.939073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507643-4756-4705-a1de-07356e50a620 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:33.941333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 691/1383] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:33.947194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a3ba-16bb-408e-b190-0e2142ddf6fa None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:33.948639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a3ba-16bb-408e-b190-0e2142ddf6fa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:33.949118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a3ba-16bb-408e-b190-0e2142ddf6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:33.972955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cb86a3ba-16bb-408e-b190-0e2142ddf6fa None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:33.975878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cb86a3ba-16bb-408e-b190-0e2142ddf6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:33.990204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 693/1384] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:34.033863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa507643-4756-4705-a1de-07356e50a620 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:34.050581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa507643-4756-4705-a1de-07356e50a620 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:34.057271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:34.058380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:34.059085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:34.059632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:34.069720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:34.071725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b698-0f16-4f92-9877-e5189d9f2826 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:34.098980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 692/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:36.370130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3756-e371-4f5a-b854-0d3e755a5491 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:36.370666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3756-e371-4f5a-b854-0d3e755a5491 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:36.370789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3756-e371-4f5a-b854-0d3e755a5491 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:36.372160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 694/1386] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:36.377654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab245-dfaf-4f75-a305-b9a5a5591fbf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:36.378112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab245-dfaf-4f75-a305-b9a5a5591fbf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:36.378204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab245-dfaf-4f75-a305-b9a5a5591fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:36.396818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f8fab245-dfaf-4f75-a305-b9a5a5591fbf None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:36.398054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8fab245-dfaf-4f75-a305-b9a5a5591fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:36.406720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 693/1387] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:36.450591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3756-e371-4f5a-b854-0d3e755a5491 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:36.468485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3756-e371-4f5a-b854-0d3e755a5491 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:36.474995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:36.475894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:36.476233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:36.476569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:36.487353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:36.489757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f83c-bf28-438e-ae20-d9c8bece19e2 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:36.504785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 695/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:39.202789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eb76-98d9-4e68-ba00-18f4e319eb5d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:39.203511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eb76-98d9-4e68-ba00-18f4e319eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:39.203511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eb76-98d9-4e68-ba00-18f4e319eb5d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:39.204813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 694/1389] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:39.211142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2b45-329d-4aa6-992f-4442e8e0546d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:39.211650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2b45-329d-4aa6-992f-4442e8e0546d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:39.211902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2b45-329d-4aa6-992f-4442e8e0546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:39.236136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4f9e2b45-329d-4aa6-992f-4442e8e0546d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:39.237802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4f9e2b45-329d-4aa6-992f-4442e8e0546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:39.249468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 696/1390] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:39.294862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684eb76-98d9-4e68-ba00-18f4e319eb5d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:39.310357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684eb76-98d9-4e68-ba00-18f4e319eb5d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:39.316736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:39.317399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:39.317681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:39.317949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:39.327731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:39.329374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb947-62d8-4361-9da5-0acc8bb972c6 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:39.339909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 695/1391] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:41.609797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e37c-e5f6-41f6-82fe-77198bf4c1ab None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:41.610394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e37c-e5f6-41f6-82fe-77198bf4c1ab None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:41.610578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e37c-e5f6-41f6-82fe-77198bf4c1ab None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:41.612427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 697/1392] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:41.618287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852475-4c94-4a27-b6b8-9ec16760e9d6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:41.618804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852475-4c94-4a27-b6b8-9ec16760e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:41.618904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852475-4c94-4a27-b6b8-9ec16760e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:41.637670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-30852475-4c94-4a27-b6b8-9ec16760e9d6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:41.638944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30852475-4c94-4a27-b6b8-9ec16760e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:41.648283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 696/1393] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:30:41.694611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e37c-e5f6-41f6-82fe-77198bf4c1ab None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:41.713775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e37c-e5f6-41f6-82fe-77198bf4c1ab None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:41.720005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:41.720720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:41.721020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:41.721298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:41.731448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:41.733223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fe57-c159-49f3-bd54-6f44b6ee1e73 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:41.744223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 698/1394] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:43.990455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348238-ebaf-43b2-9f43-131533c80a6c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:43.991277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348238-ebaf-43b2-9f43-131533c80a6c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:43.991277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348238-ebaf-43b2-9f43-131533c80a6c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:43.992542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 697/1395] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:43.998713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fb1f-0aac-40d6-8920-f93e0842bc6a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:43.999358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fb1f-0aac-40d6-8920-f93e0842bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:43.999358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fb1f-0aac-40d6-8920-f93e0842bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.006497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=52 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:44.021514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c050fb1f-0aac-40d6-8920-f93e0842bc6a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:44.022976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c050fb1f-0aac-40d6-8920-f93e0842bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:44.031571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 699/1396] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:44.074544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348238-ebaf-43b2-9f43-131533c80a6c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:44.090334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348238-ebaf-43b2-9f43-131533c80a6c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:44.096164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:44.096827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.097115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.097390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.105972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:44.107597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bad91-dc0f-43f0-89db-5fc06fa7a679 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:44.117426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 698/1397] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:44.181353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e562-2a23-46c8-ab40-1d76635d2215 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.181641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e562-2a23-46c8-ab40-1d76635d2215 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.181914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e562-2a23-46c8-ab40-1d76635d2215 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.183263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 700/1398] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:44.189442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728283-6260-43e9-8cf6-a08bfdb8994c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.189712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728283-6260-43e9-8cf6-a08bfdb8994c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.189947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728283-6260-43e9-8cf6-a08bfdb8994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.210881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1d728283-6260-43e9-8cf6-a08bfdb8994c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:44.212165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d728283-6260-43e9-8cf6-a08bfdb8994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:44.220385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 699/1399] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:44.278610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbeeab-266c-40ac-b283-5d8f87030271 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.278930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbeeab-266c-40ac-b283-5d8f87030271 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.279297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbeeab-266c-40ac-b283-5d8f87030271 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.281657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 701/1400] 10.222.0.75 () {54 vars in 962 bytes} [Thu May 26 12:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:44.286643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac762b-3693-4241-ae6a-e65f3167f3c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.286909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac762b-3693-4241-ae6a-e65f3167f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.287288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac762b-3693-4241-ae6a-e65f3167f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.347780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1aac762b-3693-4241-ae6a-e65f3167f3c6 None None] MFA Rules not processed for user `0b164dd7ea5b474d85d541ad7815f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:44.349137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1aac762b-3693-4241-ae6a-e65f3167f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:44.412138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 700/1401] 10.222.0.75 () {58 vars in 1059 bytes} [Thu May 26 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:44.420103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbeeab-266c-40ac-b283-5d8f87030271 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:44.432191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbeeab-266c-40ac-b283-5d8f87030271 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:44.436120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:44.436742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.437020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.437291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.446593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:44.448053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581358f-935f-400f-8f14-15cc51663698 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:44.458076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 702/1402] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:30:45.009608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755efce-e71e-4047-ab22-8b033dfadafe None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:45.010124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755efce-e71e-4047-ab22-8b033dfadafe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:45.010219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755efce-e71e-4047-ab22-8b033dfadafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:45.058101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2755efce-e71e-4047-ab22-8b033dfadafe None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:45.059445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2755efce-e71e-4047-ab22-8b033dfadafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:45.101493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:45.124812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 701/1403] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:30:45.165411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aed64-13ef-4efd-8f71-9afd2b08c947 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:45.165870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aed64-13ef-4efd-8f71-9afd2b08c947 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:45.165987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aed64-13ef-4efd-8f71-9afd2b08c947 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:45.167385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 703/1404] 10.222.0.75 () {54 vars in 942 bytes} [Thu May 26 12:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:45.173851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3eec-ee77-4bb2-a412-468fefc5fae1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:45.174138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3eec-ee77-4bb2-a412-468fefc5fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:45.174413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3eec-ee77-4bb2-a412-468fefc5fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:45.222341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-837c3eec-ee77-4bb2-a412-468fefc5fae1 None None] MFA Rules not processed for user `6fbd6a83714a4d88ae001e7ed462fa86`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:45.223518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-837c3eec-ee77-4bb2-a412-468fefc5fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:45.295241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 702/1405] 10.222.0.75 () {58 vars in 1039 bytes} [Thu May 26 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:45.305068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aed64-13ef-4efd-8f71-9afd2b08c947 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:45.319169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aed64-13ef-4efd-8f71-9afd2b08c947 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:45.324373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:45.325003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:45.325276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:45.325542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:45.334724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:45.336669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63d63-0e55-4783-994d-40d186741afc service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:45.345071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 704/1406] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:30:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:30:46.374729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7978a-0657-4602-949a-036e6f7e7747 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:46.375293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7978a-0657-4602-949a-036e6f7e7747 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:46.375293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7978a-0657-4602-949a-036e6f7e7747 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:46.376763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 703/1407] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:46.382404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f345-8bd0-4803-b729-4e9c2dc99f5d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:46.382880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f345-8bd0-4803-b729-4e9c2dc99f5d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:46.383204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f345-8bd0-4803-b729-4e9c2dc99f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:46.403564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b841f345-8bd0-4803-b729-4e9c2dc99f5d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:46.404767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b841f345-8bd0-4803-b729-4e9c2dc99f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:46.413035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 705/1408] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:46.457125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7978a-0657-4602-949a-036e6f7e7747 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:46.471353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7978a-0657-4602-949a-036e6f7e7747 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:46.476801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:46.477524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:46.477866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:46.478199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:46.487429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:46.489165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35078e-ece0-4f8c-9ef4-5f1ae44bbe75 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:46.504151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 704/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:56.396626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=17 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:56.498374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=59 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:08.606116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f3dd-0db3-4412-a40d-baf1001e8eeb None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:08.607135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f3dd-0db3-4412-a40d-baf1001e8eeb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:08.607135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f3dd-0db3-4412-a40d-baf1001e8eeb None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:08.608075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 706/1410] 10.222.0.75 () {54 vars in 918 bytes} [Thu May 26 12:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:08.616043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737210-c9a8-4020-930f-93e14acff8ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:08.616746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737210-c9a8-4020-930f-93e14acff8ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:08.616746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737210-c9a8-4020-930f-93e14acff8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:08.641502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-13737210-c9a8-4020-930f-93e14acff8ab None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:08.642710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13737210-c9a8-4020-930f-93e14acff8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:08.653065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 705/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Thu May 26 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:08.668839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044b01-b513-4246-b92e-8d8c5046b414 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:08.669160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044b01-b513-4246-b92e-8d8c5046b414 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:08.669536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044b01-b513-4246-b92e-8d8c5046b414 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:08.671635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 707/1412] 10.222.0.75 () {54 vars in 918 bytes} [Thu May 26 12:31:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:08.676924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cdc9-d577-47e1-8547-de97f91eeda1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:08.677235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cdc9-d577-47e1-8547-de97f91eeda1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:08.677507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cdc9-d577-47e1-8547-de97f91eeda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:08.696900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f5d8cdc9-d577-47e1-8547-de97f91eeda1 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:08.698080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f5d8cdc9-d577-47e1-8547-de97f91eeda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:08.710097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 706/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Thu May 26 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:11.406249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814c614-c2f9-4d0b-9131-151ec6ad08e3 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:11.407180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814c614-c2f9-4d0b-9131-151ec6ad08e3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:11.407180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814c614-c2f9-4d0b-9131-151ec6ad08e3 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:11.409341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:11.415652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6e42-57a5-4bb3-82d3-5ef91c3b7cc5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:11.416095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6e42-57a5-4bb3-82d3-5ef91c3b7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:11.416197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6e42-57a5-4bb3-82d3-5ef91c3b7cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:11.435649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4e9a6e42-57a5-4bb3-82d3-5ef91c3b7cc5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:11.436860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e9a6e42-57a5-4bb3-82d3-5ef91c3b7cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:11.446348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:11.490911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814c614-c2f9-4d0b-9131-151ec6ad08e3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:11.509012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814c614-c2f9-4d0b-9131-151ec6ad08e3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:11.514782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:11.515410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:11.515719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:11.515992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:11.524362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:11.526011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e50b3-5ff0-4fb2-8a29-78d4739f2475 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:11.536004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 709/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:12.514965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365a1d1-a23d-4ef3-b4a8-c9cf02c6b26a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:12.515573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365a1d1-a23d-4ef3-b4a8-c9cf02c6b26a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:12.515573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365a1d1-a23d-4ef3-b4a8-c9cf02c6b26a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:12.516962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:12.522963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972b3f-a17a-4b2b-a3d2-775cb89e2f99 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:12.523442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972b3f-a17a-4b2b-a3d2-775cb89e2f99 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:12.523570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972b3f-a17a-4b2b-a3d2-775cb89e2f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:12.551709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ca972b3f-a17a-4b2b-a3d2-775cb89e2f99 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:12.552897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ca972b3f-a17a-4b2b-a3d2-775cb89e2f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:12.561337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:12.714891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365a1d1-a23d-4ef3-b4a8-c9cf02c6b26a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:12.731891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365a1d1-a23d-4ef3-b4a8-c9cf02c6b26a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:12.738475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:12.739112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:12.739396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:12.739701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:12.748570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:12.750164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073fad-b19f-4ad7-bb50-098e09edd62a service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:12.760175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 709/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:13.700452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c46de-0d2e-4700-bcda-99c419487207 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:13.701090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c46de-0d2e-4700-bcda-99c419487207 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:13.701090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c46de-0d2e-4700-bcda-99c419487207 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:13.702506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:13.707807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240caf-5443-465b-89a6-095f498a1842 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:13.708310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240caf-5443-465b-89a6-095f498a1842 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:13.708405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240caf-5443-465b-89a6-095f498a1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:13.727596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0a240caf-5443-465b-89a6-095f498a1842 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:13.728832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0a240caf-5443-465b-89a6-095f498a1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:13.737333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:13.890722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c46de-0d2e-4700-bcda-99c419487207 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:13.907652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c46de-0d2e-4700-bcda-99c419487207 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:13.914052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:13.914681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:13.914956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:13.915230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:13.923773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:13.925415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3700f-09d1-4216-9209-9505c5593240 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:13.935394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 712/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:14.856398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09657-28e3-4b48-95b0-845fbb42ceb4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:14.857348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09657-28e3-4b48-95b0-845fbb42ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:14.857348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09657-28e3-4b48-95b0-845fbb42ceb4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:14.859489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:14.867414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad676a-4e7a-4913-9b6d-6cee008f410b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:14.867908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad676a-4e7a-4913-9b6d-6cee008f410b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:14.868032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad676a-4e7a-4913-9b6d-6cee008f410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:14.888516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-05ad676a-4e7a-4913-9b6d-6cee008f410b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:14.889740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-05ad676a-4e7a-4913-9b6d-6cee008f410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:14.899173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:15.068156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d09657-28e3-4b48-95b0-845fbb42ceb4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:15.086284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d09657-28e3-4b48-95b0-845fbb42ceb4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:15.092996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:15.093626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:15.093901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:15.094175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:15.102914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:15.104520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33981d-8703-49d5-8348-38ba33f004df service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:15.113889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 712/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:16.016386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197a63-ccbf-4a79-a5e0-79f2a6cc3093 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:16.017270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197a63-ccbf-4a79-a5e0-79f2a6cc3093 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:16.017270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197a63-ccbf-4a79-a5e0-79f2a6cc3093 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:16.019465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:16.025927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacac8-5a73-4236-a22f-78c7bafe8ae9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:16.026392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacac8-5a73-4236-a22f-78c7bafe8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:16.026514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacac8-5a73-4236-a22f-78c7bafe8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:16.048721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b7bacac8-5a73-4236-a22f-78c7bafe8ae9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:16.049912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b7bacac8-5a73-4236-a22f-78c7bafe8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:16.059195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:16.206291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7197a63-ccbf-4a79-a5e0-79f2a6cc3093 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:16.223802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7197a63-ccbf-4a79-a5e0-79f2a6cc3093 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:16.230481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:16.231107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:16.231384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:16.231693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:16.240290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:16.241879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2e5a-94d9-433f-af66-73eda74b8ab9 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:16.251164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 715/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:17.107927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ff69-21f1-43c5-865d-20fe6628635b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:17.109087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ff69-21f1-43c5-865d-20fe6628635b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:17.109473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ff69-21f1-43c5-865d-20fe6628635b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:17.111989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:17.118314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e859-f2b0-4cfb-8b77-95781e13d365 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:17.118734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e859-f2b0-4cfb-8b77-95781e13d365 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:17.118878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e859-f2b0-4cfb-8b77-95781e13d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:17.146590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ee88e859-f2b0-4cfb-8b77-95781e13d365 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:17.147896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ee88e859-f2b0-4cfb-8b77-95781e13d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:17.156607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:17.307768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ff69-21f1-43c5-865d-20fe6628635b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:17.326653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ff69-21f1-43c5-865d-20fe6628635b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:17.332814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:17.333456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:17.333738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:17.334009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:17.342366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:17.344048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525606-1857-41f8-aab3-05e92597d17f service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:17.354281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 715/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:18.196259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc9c4-fde2-444d-9255-3c14b89ed3e5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:18.196821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc9c4-fde2-444d-9255-3c14b89ed3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:18.196821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc9c4-fde2-444d-9255-3c14b89ed3e5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:18.198552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:18.204750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbfcfc-e9a9-428d-97dd-8a3d25377079 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:18.205484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbfcfc-e9a9-428d-97dd-8a3d25377079 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:18.205672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbfcfc-e9a9-428d-97dd-8a3d25377079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:18.227381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a7bbfcfc-e9a9-428d-97dd-8a3d25377079 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:18.228591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7bbfcfc-e9a9-428d-97dd-8a3d25377079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:18.236915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:18.384654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddc9c4-fde2-444d-9255-3c14b89ed3e5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:18.411384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddc9c4-fde2-444d-9255-3c14b89ed3e5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:18.419602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:18.420395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:18.420670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:18.420988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:18.432060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:18.433680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa8b0c-7e70-449e-b99e-f38640dbdfdd service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:18.444042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 718/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:19.301565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80fb1-4059-4655-ae2f-089373a89a20 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:19.302120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80fb1-4059-4655-ae2f-089373a89a20 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:19.302120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80fb1-4059-4655-ae2f-089373a89a20 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:19.304489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:19.309852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63699-f40f-4ba5-b737-d9af3a756fb1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:19.310333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63699-f40f-4ba5-b737-d9af3a756fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:19.310445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63699-f40f-4ba5-b737-d9af3a756fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:19.332753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7bb63699-f40f-4ba5-b737-d9af3a756fb1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:19.333957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7bb63699-f40f-4ba5-b737-d9af3a756fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:19.342565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:31:19.493948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80fb1-4059-4655-ae2f-089373a89a20 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:19.510045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80fb1-4059-4655-ae2f-089373a89a20 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:19.515836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:19.516478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:19.516758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:19.517040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:19.525393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:19.526983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ade4d0-4e41-46b9-8ee9-bbf9c81b8186 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:19.536556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 718/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:20.382137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbef87-f0ea-4b6f-a7fd-ed06e2404c50 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:20.382739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbef87-f0ea-4b6f-a7fd-ed06e2404c50 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:20.382739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbef87-f0ea-4b6f-a7fd-ed06e2404c50 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:20.384103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:20.390210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ccb-4040-458e-839d-43cc0c39aa0c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:20.390960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ccb-4040-458e-839d-43cc0c39aa0c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:20.391143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ccb-4040-458e-839d-43cc0c39aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:20.417728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-082e4ccb-4040-458e-839d-43cc0c39aa0c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:20.418923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-082e4ccb-4040-458e-839d-43cc0c39aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:20.428090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:20.588339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbef87-f0ea-4b6f-a7fd-ed06e2404c50 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:20.603853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbef87-f0ea-4b6f-a7fd-ed06e2404c50 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:20.609768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:20.610385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:20.610667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:20.610935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:20.619212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:20.620850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d666773-e2d6-4274-ac51-feac877c3262 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:20.630581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 721/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:22.728590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a38a-ab47-4081-8b81-156b3487639b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:22.729471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a38a-ab47-4081-8b81-156b3487639b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:22.729471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a38a-ab47-4081-8b81-156b3487639b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:22.731685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:22.740476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc6f9-f72c-4d50-84cf-3d48a1c33b4f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:22.740927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc6f9-f72c-4d50-84cf-3d48a1c33b4f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:22.741034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc6f9-f72c-4d50-84cf-3d48a1c33b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:22.765681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-109bc6f9-f72c-4d50-84cf-3d48a1c33b4f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:22.766874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-109bc6f9-f72c-4d50-84cf-3d48a1c33b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:22.776698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:22.814456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a38a-ab47-4081-8b81-156b3487639b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:22.828746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a38a-ab47-4081-8b81-156b3487639b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:22.833227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:22.833900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:22.834182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:22.834460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:22.844723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:22.846164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cddea-5ff2-46b5-a405-56c47fe12870 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:22.855945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 721/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:25.249271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea145-a45d-4aa7-be2b-0ab2b57b97d9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:25.249868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea145-a45d-4aa7-be2b-0ab2b57b97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:25.249868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea145-a45d-4aa7-be2b-0ab2b57b97d9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:25.251229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:25.258038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c376-b82d-4aaf-8843-9ebbba8e373d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:25.258836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c376-b82d-4aaf-8843-9ebbba8e373d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:25.259014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c376-b82d-4aaf-8843-9ebbba8e373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:25.282641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f161c376-b82d-4aaf-8843-9ebbba8e373d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:25.283851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f161c376-b82d-4aaf-8843-9ebbba8e373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:25.293270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:25.331653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea145-a45d-4aa7-be2b-0ab2b57b97d9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:25.344080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea145-a45d-4aa7-be2b-0ab2b57b97d9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:25.348200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:25.348838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:25.349121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:25.349392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:25.359141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:25.360629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eeb96-05b8-48c8-8b70-d8b245ba91b0 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:25.370539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 724/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:27.967198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7121-2631-4d0b-854d-ec58082894bd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:27.968178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7121-2631-4d0b-854d-ec58082894bd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:27.968178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7121-2631-4d0b-854d-ec58082894bd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:27.970304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:27.975930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d402-70f2-4ad2-a7e1-decab59a8918 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:27.976389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d402-70f2-4ad2-a7e1-decab59a8918 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:27.976496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d402-70f2-4ad2-a7e1-decab59a8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:27.996306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9ac1d402-70f2-4ad2-a7e1-decab59a8918 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:27.997490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9ac1d402-70f2-4ad2-a7e1-decab59a8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:28.007505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:28.047563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7121-2631-4d0b-854d-ec58082894bd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:28.060281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7121-2631-4d0b-854d-ec58082894bd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:28.064734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:28.065384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:28.065661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:28.065925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:28.075217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:28.076689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc322748-9e25-4f31-b76c-04ee69a473dc service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:28.086060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 724/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:30.510168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4605-d098-4217-a318-7bf764fa0d08 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:30.510824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4605-d098-4217-a318-7bf764fa0d08 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:30.510824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4605-d098-4217-a318-7bf764fa0d08 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:30.512126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:30.518631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd12-03ea-4241-83db-001ca3d79fbd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:30.519086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd12-03ea-4241-83db-001ca3d79fbd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:30.519193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd12-03ea-4241-83db-001ca3d79fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:30.544281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-31ffcd12-03ea-4241-83db-001ca3d79fbd None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:30.546052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31ffcd12-03ea-4241-83db-001ca3d79fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:30.556481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:30.596415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4605-d098-4217-a318-7bf764fa0d08 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:30.613641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4605-d098-4217-a318-7bf764fa0d08 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:30.617935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:30.618571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:30.618850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:30.619123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:30.628601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:30.630053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ca49-7d51-49c1-b266-a54b9372fc82 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:30.639578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 727/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:32.879006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:32.879615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:32.879615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:32.880985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:31:32.887473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31b16-9121-462f-94b8-e294f7954ee5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:32.887964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31b16-9121-462f-94b8-e294f7954ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:32.888061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31b16-9121-462f-94b8-e294f7954ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:32.908783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e8d31b16-9121-462f-94b8-e294f7954ee5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:32.909986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e8d31b16-9121-462f-94b8-e294f7954ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:32.919798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:32.960192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:32.963026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:32.984465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685c9a-bd52-4227-b194-3b87f4d97172 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:32.989212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:32.989853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:32.990131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:32.990404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:32.999339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:33.000797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f3a0-7887-4348-bb15-8316ab7c0783 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:33.010265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 727/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:35.265973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91b2c-3767-449a-ae61-aba1c67ac8ae None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:35.266885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91b2c-3767-449a-ae61-aba1c67ac8ae None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:35.266885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91b2c-3767-449a-ae61-aba1c67ac8ae None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:35.268660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:35.274151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973637-5a90-4e07-bc32-22c0f932b7bf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:35.274605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973637-5a90-4e07-bc32-22c0f932b7bf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:35.274713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973637-5a90-4e07-bc32-22c0f932b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:35.293261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5b973637-5a90-4e07-bc32-22c0f932b7bf None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:35.294436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b973637-5a90-4e07-bc32-22c0f932b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:35.302698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:35.343601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91b2c-3767-449a-ae61-aba1c67ac8ae None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:35.356281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91b2c-3767-449a-ae61-aba1c67ac8ae None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:35.360307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:35.360939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:35.361219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:35.361486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:35.370526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:35.372016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20630a9-5aac-4f68-8473-15b5c6bbfc99 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:35.381153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 730/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:37.639349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b448b4-628e-4a0d-a0b0-e4de0d758b08 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:37.640187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b448b4-628e-4a0d-a0b0-e4de0d758b08 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:37.640187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b448b4-628e-4a0d-a0b0-e4de0d758b08 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:37.642444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:37.651756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a3e3-5d12-4315-ac9f-9ca0a408aee6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:37.652217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a3e3-5d12-4315-ac9f-9ca0a408aee6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:37.652322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a3e3-5d12-4315-ac9f-9ca0a408aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:37.660979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=70 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:37.674996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1365a3e3-5d12-4315-ac9f-9ca0a408aee6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:37.676230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1365a3e3-5d12-4315-ac9f-9ca0a408aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:37.684740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:37.723095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b448b4-628e-4a0d-a0b0-e4de0d758b08 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:37.732228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=73 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:37.739109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b448b4-628e-4a0d-a0b0-e4de0d758b08 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:37.743320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:37.743995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:37.744274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:37.744540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:37.753807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:37.755238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cc1e-55f5-4996-ae6e-e6a305116870 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:37.764535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 730/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:40.002554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedea7a6-3299-4122-890e-36e972f01c81 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:40.003157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedea7a6-3299-4122-890e-36e972f01c81 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:40.003157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedea7a6-3299-4122-890e-36e972f01c81 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:40.005257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:40.013596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd458-879f-4c1b-83c7-d5d6747c0d21 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:40.014070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd458-879f-4c1b-83c7-d5d6747c0d21 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:40.014164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd458-879f-4c1b-83c7-d5d6747c0d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:40.038832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cfccd458-879f-4c1b-83c7-d5d6747c0d21 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:40.040102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfccd458-879f-4c1b-83c7-d5d6747c0d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:40.049101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:31:40.085729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedea7a6-3299-4122-890e-36e972f01c81 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:40.097964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedea7a6-3299-4122-890e-36e972f01c81 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:40.102154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:40.102787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:40.103033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:40.103306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:40.113389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:40.114829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecdb47-9e17-4012-b6fc-2ac94993f7c2 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:40.124661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 733/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:42.338711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675fca-3432-4343-a0e8-631bc138c2c4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:42.339329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675fca-3432-4343-a0e8-631bc138c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:42.339329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675fca-3432-4343-a0e8-631bc138c2c4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:42.340675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:42.346568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505671d-f051-4f1b-a311-eb45bda16151 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:42.347017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505671d-f051-4f1b-a311-eb45bda16151 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:42.347111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505671d-f051-4f1b-a311-eb45bda16151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:42.369766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2505671d-f051-4f1b-a311-eb45bda16151 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:42.370954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2505671d-f051-4f1b-a311-eb45bda16151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:42.379880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:42.419279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3675fca-3432-4343-a0e8-631bc138c2c4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:42.431885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3675fca-3432-4343-a0e8-631bc138c2c4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:42.436446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:42.437084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:42.437336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:42.437599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:42.447757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:42.449234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60f55-90a3-4812-b6ca-cf26baee3604 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:42.458686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 733/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:31:44.663509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf37f5-19e1-46a0-a36e-638a89958d6b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:44.664404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf37f5-19e1-46a0-a36e-638a89958d6b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:44.664584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf37f5-19e1-46a0-a36e-638a89958d6b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:44.666713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:31:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:31:44.674834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14639-423e-48d2-b75d-807a7454d723 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:44.675297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14639-423e-48d2-b75d-807a7454d723 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:44.675403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14639-423e-48d2-b75d-807a7454d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:44.693834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41e14639-423e-48d2-b75d-807a7454d723 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:31:44.695036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41e14639-423e-48d2-b75d-807a7454d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:31:44.704450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:31:44.743979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf37f5-19e1-46a0-a36e-638a89958d6b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:31:44.761584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf37f5-19e1-46a0-a36e-638a89958d6b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:31:44.768409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:31:44.769038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:31:44.769358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:31:44.769607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:31:44.780159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:31:44.781616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f2873-c144-4757-8ed6-eea198056efc service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:31:44.791837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 736/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:31:54.688559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=17 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:54.787258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=17 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:17.660033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3da5c-acf0-4bac-92c0-91974c125396 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:17.660915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3da5c-acf0-4bac-92c0-91974c125396 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:17.660915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3da5c-acf0-4bac-92c0-91974c125396 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:17.663099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 735/1471] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:17.671317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596785-70bb-4e4e-bece-afdd33517c9a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:17.671799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596785-70bb-4e4e-bece-afdd33517c9a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:17.671910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596785-70bb-4e4e-bece-afdd33517c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:17.690997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-55596785-70bb-4e4e-bece-afdd33517c9a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:17.692224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-55596785-70bb-4e4e-bece-afdd33517c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:17.701644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 737/1472] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:17.748360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43973-a806-462c-bcba-0ee88a5ef11d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:17.748647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43973-a806-462c-bcba-0ee88a5ef11d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:17.748919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43973-a806-462c-bcba-0ee88a5ef11d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:17.750273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 736/1473] 10.222.0.75 () {54 vars in 962 bytes} [Thu May 26 12:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:17.755068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61736d-1be8-4cc3-9d4c-14cfbc23da68 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:17.755357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61736d-1be8-4cc3-9d4c-14cfbc23da68 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:17.755669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61736d-1be8-4cc3-9d4c-14cfbc23da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:17.775129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a61736d-1be8-4cc3-9d4c-14cfbc23da68 None None] MFA Rules not processed for user `0b164dd7ea5b474d85d541ad7815f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:17.776598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a61736d-1be8-4cc3-9d4c-14cfbc23da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:17.785941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 738/1474] 10.222.0.75 () {58 vars in 1059 bytes} [Thu May 26 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:17.793422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43973-a806-462c-bcba-0ee88a5ef11d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:17.804668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43973-a806-462c-bcba-0ee88a5ef11d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:17.808482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:17.809090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:17.809371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:17.809640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:17.818834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:17.820292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f353f-281d-4086-9b4c-11dd86868755 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:17.830559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 737/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:20.103108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f835e-98de-4400-a88a-a70da62fc745 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.103727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f835e-98de-4400-a88a-a70da62fc745 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.103727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f835e-98de-4400-a88a-a70da62fc745 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.105819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 739/1476] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:20.113137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c674de-4f9f-485a-abcd-3ce83bf0cefc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.113563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c674de-4f9f-485a-abcd-3ce83bf0cefc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.113727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c674de-4f9f-485a-abcd-3ce83bf0cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.141192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-56c674de-4f9f-485a-abcd-3ce83bf0cefc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.142388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-56c674de-4f9f-485a-abcd-3ce83bf0cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.151570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 738/1477] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.174711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f835e-98de-4400-a88a-a70da62fc745 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.190735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f835e-98de-4400-a88a-a70da62fc745 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.196676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.197345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.197625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.197896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.198630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.200450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:20.200450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:32:20.200450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:32:20.201814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a3688-58e6-4d64-ab9a-bf150636cbac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.220868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 740/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:22.434916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412901-235b-4259-8380-ba7872818f88 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.436001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412901-235b-4259-8380-ba7872818f88 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.436001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412901-235b-4259-8380-ba7872818f88 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.437441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 739/1479] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:22.444046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef425-d2ea-43d6-8e54-019e83f23ccb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.444478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef425-d2ea-43d6-8e54-019e83f23ccb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.444605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef425-d2ea-43d6-8e54-019e83f23ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.465648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2ceef425-d2ea-43d6-8e54-019e83f23ccb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.466901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ceef425-d2ea-43d6-8e54-019e83f23ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.475185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 741/1480] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.520260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd412901-235b-4259-8380-ba7872818f88 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.536654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd412901-235b-4259-8380-ba7872818f88 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.542961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.543597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.543902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.544173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.557569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.559156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4621-e819-420d-a240-4f1ff9365d91 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.575798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 740/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:24.950093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5f0f-2745-4c64-844b-4e612d2f2bb2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.950681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5f0f-2745-4c64-844b-4e612d2f2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.950681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5f0f-2745-4c64-844b-4e612d2f2bb2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.952088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 742/1482] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:24.958292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f87f-e0a8-46e4-8985-ff3a2a0c6285 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.958739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f87f-e0a8-46e4-8985-ff3a2a0c6285 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.958848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f87f-e0a8-46e4-8985-ff3a2a0c6285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.977869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7749f87f-e0a8-46e4-8985-ff3a2a0c6285 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:24.979057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7749f87f-e0a8-46e4-8985-ff3a2a0c6285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:24.987420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 741/1483] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.024515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b5f0f-2745-4c64-844b-4e612d2f2bb2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.036185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b5f0f-2745-4c64-844b-4e612d2f2bb2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:25.039906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:25.040468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.040745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.041012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.050642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:25.052128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d16e1-7f2b-48b0-b25a-3ec187202e8d service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:25.061854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 743/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:27.329982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc259e33-6f54-4b5a-9b91-a62e72e708f6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.330610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc259e33-6f54-4b5a-9b91-a62e72e708f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.330610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc259e33-6f54-4b5a-9b91-a62e72e708f6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.331969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 742/1485] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:27.338430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3153-827e-498a-bacd-22706f9a5bb0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.338875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3153-827e-498a-bacd-22706f9a5bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.338996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3153-827e-498a-bacd-22706f9a5bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.360568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-124c3153-827e-498a-bacd-22706f9a5bb0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:27.361764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-124c3153-827e-498a-bacd-22706f9a5bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.371163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 744/1486] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:27.409126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc259e33-6f54-4b5a-9b91-a62e72e708f6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:27.421280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc259e33-6f54-4b5a-9b91-a62e72e708f6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:27.425390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:27.426031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.426314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.426586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.436560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:27.438091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaddf-f16b-4c6f-b2b8-690316b12220 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:27.448104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 743/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:29.784162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296267-81bd-4d34-bb97-063264300263 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.784765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296267-81bd-4d34-bb97-063264300263 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.784765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296267-81bd-4d34-bb97-063264300263 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.786470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 745/1488] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:29.791794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd8-d849-473f-aec6-6ac4441f575b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.792359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd8-d849-473f-aec6-6ac4441f575b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.792359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd8-d849-473f-aec6-6ac4441f575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.811004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cbffacd8-d849-473f-aec6-6ac4441f575b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:29.812252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cbffacd8-d849-473f-aec6-6ac4441f575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.820887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 744/1489] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:29.861993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44296267-81bd-4d34-bb97-063264300263 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.874480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44296267-81bd-4d34-bb97-063264300263 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:29.878933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:29.879561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.879879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.880149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.890329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:29.891816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d04db-c0d3-43f8-95d1-424c4935a250 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.901103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 746/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:32.301737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa2a9-5546-4362-9183-b21be29c4d70 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.302376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa2a9-5546-4362-9183-b21be29c4d70 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.302376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa2a9-5546-4362-9183-b21be29c4d70 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.303723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 745/1491] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 26 12:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:32.310018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb130-7035-4a64-909b-75b0ec6d64c4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.310779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb130-7035-4a64-909b-75b0ec6d64c4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.311075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb130-7035-4a64-909b-75b0ec6d64c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.330498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f66cb130-7035-4a64-909b-75b0ec6d64c4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:32.331724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f66cb130-7035-4a64-909b-75b0ec6d64c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:32.340809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 747/1492] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 26 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:32.381197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa2a9-5546-4362-9183-b21be29c4d70 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.399185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa2a9-5546-4362-9183-b21be29c4d70 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:32.405373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:32.406043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.406323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.406594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.415991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:32.417435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f4616-5142-447e-9c85-34e2a137b7f3 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:32.427440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 746/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:42.325001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=33 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:42.422943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=33 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:12.546438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.547081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.547081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.570768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:12.571983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:12.580301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 748/1494] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:12.589675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.590198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.590198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.616388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:12.618170 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:12.629397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 747/1495] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:12.634043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.643926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec4daa-603f-4315-87f2-bdd295cd7d11 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.649764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.650393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.650666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.650934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.651691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:12.651993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.653046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.653046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:34:12.653046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:34:12.653908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.666180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 749/1496] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:12.674413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.684049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337834d-0ca5-4312-a816-f9fccfa28430 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.690038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.690693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.690971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.691240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.691977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.693735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.693735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:34:12.693735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:34:12.694965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.738397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 748/1497] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:34:12 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:12.743231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.755271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1f876-323c-41ac-aa40-98204158911e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.816302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.816900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.817175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.817443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.818130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.819168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.819168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:34:12.819168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:34:12.820398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.844175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 750/1498] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:34:12 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:12.850090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.861523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9799ea-9e08-45cf-aa63-41feac564dbc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.866800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.867444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.867773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.868043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.868766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.869782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.869782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:34:12.869782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:34:12.870660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.883558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 749/1499] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:12.887851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.898166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb010-218a-4708-85de-8329036eca9b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.903461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.904154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.904433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.904702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.905503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.906530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.906530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:34:12.906530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:34:12.907415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e280-d351-4952-a96d-5e22df28ada6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.920190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 751/1500] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:12.924388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:12.934586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0aba-5c03-4a13-b29a-39d9116d9e14 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:12.939254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:12.940162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.940443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.940708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] PATH_INFO: `/v3/projects/f58ae783aefb48448786bd34134eb9aa/users/3610626a9e724c1782bce48dfe4c2e73/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:12.956551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58ae783aefb48448786bd34134eb9aa, user_id=3610626a9e724c1782bce48dfe4c2e73, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:12.957579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:12.957579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:34:12.957579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:34:12.959487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb0286-160d-41f7-811d-a27c33ca5655 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:12.974302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 750/1501] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:34:12 2022] PUT /identity/v3/projects/f58ae783aefb48448786bd34134eb9aa/users/3610626a9e724c1782bce48dfe4c2e73/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:12.986173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0ae-3961-4e9d-8e61-70ab6764ce52 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:12.986488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0ae-3961-4e9d-8e61-70ab6764ce52 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:12.986764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0ae-3961-4e9d-8e61-70ab6764ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.014038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f98ec0ae-3961-4e9d-8e61-70ab6764ce52 None None] MFA Rules not processed for user `3610626a9e724c1782bce48dfe4c2e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:13.015436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f98ec0ae-3961-4e9d-8e61-70ab6764ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:13.081850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 752/1502] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:13.095591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ffb9-5727-46cf-b81e-59d1bae46526 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.095887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ffb9-5727-46cf-b81e-59d1bae46526 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.096162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ffb9-5727-46cf-b81e-59d1bae46526 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.097570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 751/1503] 10.222.0.75 () {54 vars in 963 bytes} [Thu May 26 12:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:13.102458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0427-8f87-42a2-9c32-f964babc4cef None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.102776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0427-8f87-42a2-9c32-f964babc4cef None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.103074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0427-8f87-42a2-9c32-f964babc4cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.122722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d95b0427-8f87-42a2-9c32-f964babc4cef None None] MFA Rules not processed for user `7df29f2915c446f5b3c0ed3cfb14a89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:13.124027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d95b0427-8f87-42a2-9c32-f964babc4cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:13.167753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:13.179811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 753/1504] 10.222.0.75 () {58 vars in 1060 bytes} [Thu May 26 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:13.186543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ffb9-5727-46cf-b81e-59d1bae46526 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:13.197388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ffb9-5727-46cf-b81e-59d1bae46526 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:13.201131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:13.201766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.202008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.202306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.210658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:13.212143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:13.220950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 752/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:13.273521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f07de-301f-41a9-aa23-7dc89d69f516 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.273968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f07de-301f-41a9-aa23-7dc89d69f516 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.274430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f07de-301f-41a9-aa23-7dc89d69f516 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.276642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 754/1506] 10.222.0.75 () {52 vars in 829 bytes} [Thu May 26 12:34:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:13.282207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:13.350455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e9bd3-bbea-4d9a-b2ab-dbe41a730754 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:13.355467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:13.356356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.356642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.356912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] PATH_INFO: `/v3/users/3610626a9e724c1782bce48dfe4c2e73` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.358127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3610626a9e724c1782bce48dfe4c2e73)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:13.359182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:13.359182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:34:13.359182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:34:13.360407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:13.428412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3610626a9e724c1782bce48dfe4c2e73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:13.429104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3610626a9e724c1782bce48dfe4c2e73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:13.442455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3610626a9e724c1782bce48dfe4c2e73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:13.469700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3610626a9e724c1782bce48dfe4c2e73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:13.470908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3610626a9e724c1782bce48dfe4c2e73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:13.477499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:13.493035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 753/1507] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:34:13 2022] DELETE /identity/v3/users/3610626a9e724c1782bce48dfe4c2e73 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:13.497601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.497885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.498209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.518126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:13.519322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:13.580581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 755/1508] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:13.592965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:13.595153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:13.658433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d5e7-faae-47d7-9e0b-da9ca236efc0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:13.662593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:13.663250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:13.663569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:13.663849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:13.674892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:13.675771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956290b-678c-4601-8b1a-a8af76ff630b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:13.686120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 754/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:14.027856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:14.029761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:14.043360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719591fa-dde2-4771-abe4-b2cf2290a255 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:14.049015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:14.050121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:14.050483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:14.050822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] PATH_INFO: `/v3/projects/f58ae783aefb48448786bd34134eb9aa` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:14.052414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58ae783aefb48448786bd34134eb9aa)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:14.053535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:14.053535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:34:14.053535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:34:14.054926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:14.118768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58ae783aefb48448786bd34134eb9aa', 'request_id': 'req-4765ff95-dc72-471f-9898-c08986f6df2d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:14.135782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58ae783aefb48448786bd34134eb9aa', 'request_id': 'req-4765ff95-dc72-471f-9898-c08986f6df2d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:14.145537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58ae783aefb48448786bd34134eb9aa', 'request_id': 'req-4765ff95-dc72-471f-9898-c08986f6df2d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:14.163397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] The token cache is being invalidate because project f58ae783aefb48448786bd34134eb9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:14.163713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:14.164492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4765ff95-dc72-471f-9898-c08986f6df2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:14.166281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 756/1510] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:34:14 2022] DELETE /identity/v3/projects/f58ae783aefb48448786bd34134eb9aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:23.681199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:24.160234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:59.635813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.636786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.636786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.638926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:35:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:59.644545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0716b-369f-46cd-aa94-122852640718 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.645007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0716b-369f-46cd-aa94-122852640718 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.645120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0716b-369f-46cd-aa94-122852640718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.663744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-40c0716b-369f-46cd-aa94-122852640718 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.665020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-40c0716b-369f-46cd-aa94-122852640718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.729755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:59.901140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.904378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.988467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73110f6-6133-488f-9d75-15b455f79762 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.994564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.995221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.995505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.995806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.004103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.005684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a01ad-8b90-4687-9551-51c271884e9a service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.015014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 756/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:00.828071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a99b5-df73-41e6-93fb-65eb5fe2f61b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.828635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a99b5-df73-41e6-93fb-65eb5fe2f61b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.828635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a99b5-df73-41e6-93fb-65eb5fe2f61b None None] PATH_INFO: `/v3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.829952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 758/1514] 10.222.0.59 () {54 vars in 925 bytes} [Thu May 26 12:36:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:00.836698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.837127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.837220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.856647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:00.857875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.896362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8ec4-05fb-45f5-bfb5-90c9d1a2b5fe None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.896688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8ec4-05fb-45f5-bfb5-90c9d1a2b5fe None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.896962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8ec4-05fb-45f5-bfb5-90c9d1a2b5fe None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.898329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 759/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:00.903058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1f0e-a160-448e-a5f4-2fbf13c8754f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.903327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1f0e-a160-448e-a5f4-2fbf13c8754f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.903633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1f0e-a160-448e-a5f4-2fbf13c8754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.922052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f61e1f0e-a160-448e-a5f4-2fbf13c8754f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:00.922665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 757/1516] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:00.923253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f61e1f0e-a160-448e-a5f4-2fbf13c8754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.931021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:01.087482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:01.107980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0808-52ed-4dcc-9b3b-ea21ee3d2022 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:01.114580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:01.115225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:01.115506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:01.115801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:01.123981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:01.125573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0a04a-66a2-4e68-b6ef-f2217be8b571 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:01.134908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 758/1518] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:10.484577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b5536-7078-4726-9f50-5df6384d22c5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.485191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b5536-7078-4726-9f50-5df6384d22c5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.485191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b5536-7078-4726-9f50-5df6384d22c5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.487119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 761/1519] 10.222.0.75 () {54 vars in 960 bytes} [Thu May 26 12:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:10.492995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d13-0584-4df2-a0fa-a1425b4d6334 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.493456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d13-0584-4df2-a0fa-a1425b4d6334 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.493560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d13-0584-4df2-a0fa-a1425b4d6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.517326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-268a3d13-0584-4df2-a0fa-a1425b4d6334 None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:10.518526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-268a3d13-0584-4df2-a0fa-a1425b4d6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:10.528154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 759/1520] 10.222.0.75 () {58 vars in 1057 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:10.535844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b5536-7078-4726-9f50-5df6384d22c5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.551808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b5536-7078-4726-9f50-5df6384d22c5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.557310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.557948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.558232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.558506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.566659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.568367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf7606-1574-4f57-b418-9b090e293507 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.577862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 762/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:12.408037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fc4b-dba5-4daf-9ded-d9b88adf2d2d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:12.408912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fc4b-dba5-4daf-9ded-d9b88adf2d2d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:12.408912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fc4b-dba5-4daf-9ded-d9b88adf2d2d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:12.411091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:12.416166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6540c5-0020-4215-bc89-812cebad09f3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:12.416605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6540c5-0020-4215-bc89-812cebad09f3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:12.416713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6540c5-0020-4215-bc89-812cebad09f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:12.435528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a6540c5-0020-4215-bc89-812cebad09f3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:12.436783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a6540c5-0020-4215-bc89-812cebad09f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:12.445279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:12.600848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44fc4b-dba5-4daf-9ded-d9b88adf2d2d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:12.616742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44fc4b-dba5-4daf-9ded-d9b88adf2d2d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:12.623496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:12.624157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:12.624432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:12.624700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:12.633452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:12.635052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8b762-b16a-4969-80dc-25cc1faa8e14 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:12.644923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 761/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:13.532052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86414c-887f-4bf7-9581-c8737ddf5834 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.532671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86414c-887f-4bf7-9581-c8737ddf5834 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.532671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86414c-887f-4bf7-9581-c8737ddf5834 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.533991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:13.540265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd8e9-c078-4559-9b8a-54e863c04df9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.541019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd8e9-c078-4559-9b8a-54e863c04df9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.541123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd8e9-c078-4559-9b8a-54e863c04df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.566538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2dfdd8e9-c078-4559-9b8a-54e863c04df9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:13.567765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2dfdd8e9-c078-4559-9b8a-54e863c04df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.577375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:13.732396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86414c-887f-4bf7-9581-c8737ddf5834 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.749037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86414c-887f-4bf7-9581-c8737ddf5834 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:13.755821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:13.756465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.756744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.757015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.765687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:13.767293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420b1b2-0b81-4380-afec-c173f3e5dabb service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:13.777655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 765/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:17.878264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b394a-c9ce-438d-947c-251622164bbf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.879161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b394a-c9ce-438d-947c-251622164bbf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.879161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b394a-c9ce-438d-947c-251622164bbf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.881560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:17.888011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a354c-2896-41f0-9250-8277f8918b3d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.888460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a354c-2896-41f0-9250-8277f8918b3d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.888564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a354c-2896-41f0-9250-8277f8918b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.917123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-521a354c-2896-41f0-9250-8277f8918b3d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:17.918342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-521a354c-2896-41f0-9250-8277f8918b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.926986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:17.962750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b394a-c9ce-438d-947c-251622164bbf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.964929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-010b394a-c9ce-438d-947c-251622164bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.016433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:18.031871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b394a-c9ce-438d-947c-251622164bbf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.035894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.036550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.036836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.037113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.046525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.048015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d180d-e3d0-4b6d-871c-4964cf60fcf0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.057990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 764/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:20.247613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5e93-9660-4a37-b27c-00fdbefad86a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:20.248496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5e93-9660-4a37-b27c-00fdbefad86a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:20.248496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5e93-9660-4a37-b27c-00fdbefad86a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:20.250791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:36:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:20.259351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7e51-3dd5-4499-803d-bbc84da12174 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:20.259820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7e51-3dd5-4499-803d-bbc84da12174 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:20.259984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7e51-3dd5-4499-803d-bbc84da12174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:20.285096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1daf7e51-3dd5-4499-803d-bbc84da12174 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:20.286285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1daf7e51-3dd5-4499-803d-bbc84da12174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:20.296033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:20.331950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f5e93-9660-4a37-b27c-00fdbefad86a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:20.343920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f5e93-9660-4a37-b27c-00fdbefad86a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:20.347797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:20.348424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:20.348700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:20.348969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:20.358272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:20.359742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de72e0-eae8-4955-8ef3-658dce8de534 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:20.369927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 768/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:24.170045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.170630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.170630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.172033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:24.178553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25248-bd09-4f7f-90bd-4e34b943d29a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.179326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25248-bd09-4f7f-90bd-4e34b943d29a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.179608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25248-bd09-4f7f-90bd-4e34b943d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.189884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=55 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:24.210853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dfd25248-bd09-4f7f-90bd-4e34b943d29a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:24.212114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dfd25248-bd09-4f7f-90bd-4e34b943d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.222788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:24.501524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.503525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.567367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcee9b-6d17-4502-ae2d-5205559e36dd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.571723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.572372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.572651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.572921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.582156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.583641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706895c2-3478-488b-bc09-cc9fd8699bf0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.593320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 767/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:26.794229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:26.794723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:26.794723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:26.796182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:36:26.802442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c387-ffdd-4834-9ac1-1c71d991c573 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:26.802940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c387-ffdd-4834-9ac1-1c71d991c573 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:26.802940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c387-ffdd-4834-9ac1-1c71d991c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:26.824105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-12b0c387-ffdd-4834-9ac1-1c71d991c573 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:26.825320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-12b0c387-ffdd-4834-9ac1-1c71d991c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:26.834536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:27.101934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:27.104045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:27.117818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804d484-c29f-47dd-a270-fd3b61b0cdea None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:27.121599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:27.122231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:27.122508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:27.122796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:27.131891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:27.133355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15166b-ffe3-43a3-89d2-e2e32fc5dc28 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:27.142774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 771/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:36.818648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=39 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:37.138919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=8 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:58.818279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824b0e-093e-4bb7-9cf7-82a7f8a10528 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:58.818931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824b0e-093e-4bb7-9cf7-82a7f8a10528 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:58.818931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824b0e-093e-4bb7-9cf7-82a7f8a10528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:58.846093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-11824b0e-093e-4bb7-9cf7-82a7f8a10528 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:58.848454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-11824b0e-093e-4bb7-9cf7-82a7f8a10528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:58.862627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 769/1540] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:58.881878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:58.882488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:58.882488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:58.897646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc31e-d8e4-4db4-b3bf-32b33c127832 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:58.898419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc31e-d8e4-4db4-b3bf-32b33c127832 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:58.898912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc31e-d8e4-4db4-b3bf-32b33c127832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:58.912761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:58.914092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:58.928371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-72efc31e-d8e4-4db4-b3bf-32b33c127832 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:58.931223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-72efc31e-d8e4-4db4-b3bf-32b33c127832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:58.935573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 772/1541] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:58.940137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:58.946586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 770/1542] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 12:37:58.950862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd85b1-5e5d-49e1-9321-ff0ca19e1c62 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:58.961307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:58.962319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:58.962597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:58.962866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:58.963661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:58.963973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:58.965717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:58.987838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 773/1543] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:37:58.990755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:58.991364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:58.991902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:58.996793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.010808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28c1c-076c-45d8-92f4-5c66e683ff16 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.026061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.026959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.027671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.027949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.028235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.028816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.028926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.029991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:59.029991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:37:59.029991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:37:59.031190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92950841-6713-46c7-a248-eb96d8960bcf admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.055616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 771/1544] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.075897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.090096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a9df2-e2b1-46a6-bbcc-ad9e7f2b9241 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.090861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 774/1545] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:58 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.094994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fff0-3546-460c-aa20-842c43d1da22 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.095300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fff0-3546-460c-aa20-842c43d1da22 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.095565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fff0-3546-460c-aa20-842c43d1da22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.253850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.254969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.255461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.256022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.257323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.258053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.259374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:59.259374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:37:59.259374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:37:59.260700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.289043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 772/1546] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:37:59.290423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.303619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa9f6-4fc7-43b4-8611-d3bf4a7e834d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.309555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.310622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.311144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.311873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.312803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.314040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:59.314040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:37:59.314040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:37:59.315672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fae4a-8f36-4174-829a-fd573403bae9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.326404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8275fff0-3546-460c-aa20-842c43d1da22 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.328024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8275fff0-3546-460c-aa20-842c43d1da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.337834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 775/1547] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.339187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aa29-a286-4bc0-81f0-76ac40607df4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.339426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aa29-a286-4bc0-81f0-76ac40607df4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.339708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 773/1548] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/users => generated 300 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.339824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aa29-a286-4bc0-81f0-76ac40607df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.341503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.341788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.342062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.362282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-44a5aa29-a286-4bc0-81f0-76ac40607df4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.363506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-44a5aa29-a286-4bc0-81f0-76ac40607df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.364049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.365212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.371752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 776/1549] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.372806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d3487-86f7-40a8-9a99-7742d9e73a40 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.373088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d3487-86f7-40a8-9a99-7742d9e73a40 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.373359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d3487-86f7-40a8-9a99-7742d9e73a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.373521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 774/1550] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.374318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.384232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4080d1a-d014-49a7-bb25-4c382689ac15 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.388747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.389416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.389699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.389972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.390688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.392769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.395376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-348d3487-86f7-40a8-9a99-7742d9e73a40 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.396600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-348d3487-86f7-40a8-9a99-7742d9e73a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.404624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 777/1551] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.405844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe469ce-a533-4c46-83e4-97ad27671cc3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.406128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe469ce-a533-4c46-83e4-97ad27671cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.406394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe469ce-a533-4c46-83e4-97ad27671cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.419505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 775/1552] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.423148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.430878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-abe469ce-a533-4c46-83e4-97ad27671cc3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.432115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-abe469ce-a533-4c46-83e4-97ad27671cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.484364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e11dd-441c-4d41-ac27-c2d31902f453 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.489688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.490388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.490648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.490930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.491789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.493414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d534-3539-4027-8952-f3aeacc2de25 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.494964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 778/1553] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.496295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b050-0b09-4f4e-8ecb-831cb1bfa2f2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.496574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b050-0b09-4f4e-8ecb-831cb1bfa2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.496842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b050-0b09-4f4e-8ecb-831cb1bfa2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.504562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 776/1554] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:37:59.506394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096bac8-23e9-4c9f-93d2-4fd78bb929e5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.506745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096bac8-23e9-4c9f-93d2-4fd78bb929e5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.507026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096bac8-23e9-4c9f-93d2-4fd78bb929e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.520654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9436b050-0b09-4f4e-8ecb-831cb1bfa2f2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.521847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9436b050-0b09-4f4e-8ecb-831cb1bfa2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.527044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9096bac8-23e9-4c9f-93d2-4fd78bb929e5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.528235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9096bac8-23e9-4c9f-93d2-4fd78bb929e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.531061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 779/1555] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.532170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789255a-391e-4f0b-8c57-44aaeb16030c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.532450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789255a-391e-4f0b-8c57-44aaeb16030c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.532719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789255a-391e-4f0b-8c57-44aaeb16030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.546364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 777/1556] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.547587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.548198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.548198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.560887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a789255a-391e-4f0b-8c57-44aaeb16030c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.562099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a789255a-391e-4f0b-8c57-44aaeb16030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.567296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.568480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.570216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 780/1557] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.574035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6366-61fc-4ccf-8139-625056f3e0ed None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.574035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6366-61fc-4ccf-8139-625056f3e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.574035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6366-61fc-4ccf-8139-625056f3e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.580078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 778/1558] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.580908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.590516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc904a-d9fd-4c4a-a4cb-fcb3e530940b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.594873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-64ca6366-61fc-4ccf-8139-625056f3e0ed None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.594999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.595655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.595937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.596096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-64ca6366-61fc-4ccf-8139-625056f3e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.596251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.596887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.598799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.603808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 781/1559] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.608231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:59.608748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c382f-5ec0-4835-8b78-2aee61e0aaae None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.609035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c382f-5ec0-4835-8b78-2aee61e0aaae None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.609303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c382f-5ec0-4835-8b78-2aee61e0aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.624197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 779/1560] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.625080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.628982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-881c382f-5ec0-4835-8b78-2aee61e0aaae None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.630203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-881c382f-5ec0-4835-8b78-2aee61e0aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.635049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4d7b-4b3c-4fcc-aac2-800b288c23ce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.638966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 782/1561] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.639808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.640429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.640548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.640727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.640835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.640998 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.641098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.641801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.643719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.655011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 780/1562] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:37:59.655891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.663328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:59.664754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:59.665307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc89c-00a6-4846-98c9-acc6bbe00144 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.669738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.670366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.670645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.671021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.671781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.672084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.672595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 783/1563] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:59.673660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.677117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.686009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 781/1564] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.686563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c20503-1337-4cf9-bfe7-02f13b26df98 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.686821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.691143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.691823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.692105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.692374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.693496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.693803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.695481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.697014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a354-1916-40c9-91b8-f39f0f772870 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.702052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.702703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.702985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.703317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.704442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.704442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.705967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.714251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 784/1565] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.714251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.718558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 782/1566] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.719435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.719589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7a89a-6566-45ee-b6c9-7edb1eb3f45c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.724124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.724768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.725047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.725471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.726195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.726497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.728130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.730910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1c6ad-c3cd-42ec-8718-8f13df4972e6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.736132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.736790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.737073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.737350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.738073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.739706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.740522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 785/1567] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.741491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.750521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 783/1568] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:37:59.751273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.755360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473db7fa-dba2-4012-991a-2accaeec0032 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.761171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.761387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de594ef-f0cf-4cc5-bb91-ba3af0c7f3f3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.761814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.762094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.762373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.763094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.763392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.765030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.766146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.767010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.767294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.767593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] PATH_INFO: `/v3/projects/d0f836a599084f8d9dc754f766a86332/users/cc3a199952bc4b46838ecff13ee10e94/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.778082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 786/1569] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.778751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.790829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f836a599084f8d9dc754f766a86332, user_id=cc3a199952bc4b46838ecff13ee10e94, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.792302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1da8-545b-4012-bc33-2e9e60cf9222 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.793643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.797597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.798264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.798554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.798818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.799518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:59.799851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.801569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.808048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 784/1570] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:37:59 2022] PUT /identity/v3/projects/d0f836a599084f8d9dc754f766a86332/users/cc3a199952bc4b46838ecff13ee10e94/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:59.808646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.814299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 787/1571] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:59.815112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.825352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597774-f56a-4b15-b749-d2a6d453bfd5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.835105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:59.883129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80802-3155-490e-9b1c-218f2cd73e18 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.886409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.887131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.887405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.887711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.888400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.888528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.889138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.889423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.889702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.890309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.890445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.892470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.917974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 788/1572] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.918926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.923437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 785/1573] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:59.923437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:59.981853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f944b0b-0e08-447d-a14d-66f8264334f5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.982552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970bd6-68c6-481b-b6e2-35673fc3743f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:59.986895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.987204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:59.987587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.987879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.988001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:59.988180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.988278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:59.988449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:59.988880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.989134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:59.990809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:59.991080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.001154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.019713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 789/1574] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.021524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 786/1575] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:37:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.022396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.023589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.087262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cb236-0994-4034-879d-9aa1c69f988d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.092205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.092885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.093173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.093439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.093782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26427-a733-49e7-a79a-b7a5cb07ef81 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.094165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.095809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3714fd-9201-476e-b8aa-8aca7debcad2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.099733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.100760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.101256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.101603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.102299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.104268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.106274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 787/1576] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.107355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.107670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.107978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.134350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 790/1577] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.134350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.134709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] MFA Rules not processed for user `cc3a199952bc4b46838ecff13ee10e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:00.136141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:00.142107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.195476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3a8d-d716-4a9d-96de-4a4d6aedca8f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.200235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.200984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.201107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 788/1578] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:00.201450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.201766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.201948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.202452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.204409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.212037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb71d-aa7c-4d8b-8adb-fd501cf6c654 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.216776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.217577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.217865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.218136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.218838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.220863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.232126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 791/1579] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.232961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.245564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 789/1580] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.245564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.252807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f9ea-5c1b-41f8-bdbf-7562d5696a3a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.299391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f566-1265-4de3-a078-cfe8744f9c63 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.304275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.304952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.305234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.305509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.306205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.308187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.309253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.309925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.310208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.310482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.311171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.313116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.320073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.330817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 792/1581] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.332562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.335638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 790/1582] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.336434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.344406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029fe4-750e-41cd-b6ec-600175d9dcf3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.346007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf91a-07d2-4ebd-8533-41067aff831f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.349541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.350218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.350636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.350801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.351067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.351667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.351781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.351953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.352230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] PATH_INFO: `/v3/projects/2675272fb40d4847819f83ec04afecef/users/e811736979c44b02b14fecb74c6bd7ab/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.353734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.368598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2675272fb40d4847819f83ec04afecef, user_id=e811736979c44b02b14fecb74c6bd7ab, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.371512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.378364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 793/1583] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.378364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.386385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c90a-a2f8-49b0-a6e5-bfec6c99b621 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.387986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 791/1584] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:00 2022] PUT /identity/v3/projects/2675272fb40d4847819f83ec04afecef/users/e811736979c44b02b14fecb74c6bd7ab/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:00.388745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.447931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.448604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.448920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.449197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.449882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.451842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.452602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0fd4-f766-4fe7-92c1-6649e6ba3642 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.457142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.457802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.458083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.458357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.459038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.461088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.461965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.474020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 794/1585] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.474942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.485294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ddbc-5d80-45f0-b19b-95202d2cba11 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.489226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 792/1586] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.489933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.490067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.490676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.490989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.491259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.492054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.493991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.514030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 795/1587] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 284 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.514910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.526986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48377099-8d19-49ec-80bb-5fdf46dc2d08 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.553793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec504d6-83b4-414b-a729-87d4cca91efe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.558376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.559044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.559323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.559618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.560375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.561955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.575087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 793/1588] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.575087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.583135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecb6e4-8fc4-4ae0-af64-10e77f7acfab admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.583995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.584710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.584994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.585267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.586001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.587657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.588228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.588861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.589128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.589414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.590137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.591745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeee82-eb37-4b9e-bb4e-fdc27a2cb7c8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.598250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 796/1589] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.599031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.604971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 794/1590] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.606132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.606419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.606695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.611474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a43d-8cfa-482a-b7f3-8f7f4fdddc79 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.616258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.617039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.617316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.617587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.618307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.620033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.624533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:00.625740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:00.629933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 797/1591] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.630698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.633946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 795/1592] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:00.634708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.640692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8193b84-c775-4cb2-8596-84e5760b2f5b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.644497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f48b3f-f101-48b4-a158-2dacbf0fcc35 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.645377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.646036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.646318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.646619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.647382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.649033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.649804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.650470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.650756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.651037 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.651781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.653689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.659641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 798/1593] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.660431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.670515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75413b8-e859-426b-a259-040bc8bb89e3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.675143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.675681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 796/1594] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:00 2022] POST /identity/v3/users => generated 309 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:00.675816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.676097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.676361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.676462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.677077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.678937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.685649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179c2a-9f46-45b8-8e2b-c837448d5f4c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.692682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 799/1595] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.692840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.692960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.693064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.693064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.693064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.693064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.693897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.699441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.700271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e5db-9676-41ff-91c3-6cf9b3a6f29f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.704872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 797/1596] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.705284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.705703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.705907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.706188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.706459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.707176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.708873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.718860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa25c-7593-48e7-87f6-587ac95be9c3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.719118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 800/1597] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.719957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.724103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.724968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.725306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.725705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.726551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.728211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.729138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eb997-830b-4047-8b01-4eb5bf7714c5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.733711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.734335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.734615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.734888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.735633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.737215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.738938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 798/1598] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.739773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.750887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 801/1599] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.752263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.762696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1f44-b1a2-4277-9e31-b9d079fe2221 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.767874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.768514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.768789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.769058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.769766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.771375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.783504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 802/1600] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.784504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.794238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcf15-f936-4817-ae0a-8168db00ddd5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.799451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.800128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.800398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.800664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.801378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.801482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33b6f2-acfa-4d88-a069-814a19a072d2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.802967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.805263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.805894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.806176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.806451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.815123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 803/1601] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.816235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.820269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.821860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.827863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc195-48da-420f-9976-b2c7292c5650 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.832346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 799/1602] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:00.832573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.833011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.833144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.833310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.833573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.834273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.836030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.842418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd2fb6-2fe5-488c-a5ee-d4f5a9c0af51 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.846555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 804/1603] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:00.847339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.847459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.848427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.848729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.849070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] PATH_INFO: `/v3/projects/ebeac679b5e341f4bd5781e021234969/users/c9d2254c24884aafa36824feb2a95fb4/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.857811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2d1bd-41b1-4537-be37-e352f5045954 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.862937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.863947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.864238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.864481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] PATH_INFO: `/v3/projects/9e36ab03283d4ce6a2fed5e111e03d34/users/0431b1f25497443ba483b3c440669080/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.872939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeac679b5e341f4bd5781e021234969, user_id=c9d2254c24884aafa36824feb2a95fb4, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.877053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.880919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e36ab03283d4ce6a2fed5e111e03d34, user_id=0431b1f25497443ba483b3c440669080, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:00.882316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:38:00.882316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:38:00.882316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:38:00.884647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:00.892805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 800/1604] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:00 2022] PUT /identity/v3/projects/ebeac679b5e341f4bd5781e021234969/users/c9d2254c24884aafa36824feb2a95fb4/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:00.894226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.905901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 805/1605] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:00 2022] PUT /identity/v3/projects/9e36ab03283d4ce6a2fed5e111e03d34/users/0431b1f25497443ba483b3c440669080/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:00.910487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:00.938203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:00.976803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b224-4e09-451c-94a3-87a6142ddd16 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.982408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.983338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.983649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.983906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56adf5-a6de-42bf-84c2-1951e39225f4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:00.984106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] PATH_INFO: `/v3/projects/8af34fa3679e4dacafe5402b1520a70c/users/ea99e631ab594cd889a62ab1c61cb5e0/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:00.989007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:00.989955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:00.990234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:00.990571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] PATH_INFO: `/v3/projects/f0f340fa7ff24ca899b0f1036d0e6a3b/users/5d19942e971b4d7fac3ab8f9a5ad6086/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.000630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af34fa3679e4dacafe5402b1520a70c, user_id=ea99e631ab594cd889a62ab1c61cb5e0, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.003367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.009996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f340fa7ff24ca899b0f1036d0e6a3b, user_id=5d19942e971b4d7fac3ab8f9a5ad6086, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.012864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.033005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 806/1606] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:00 2022] PUT /identity/v3/projects/f0f340fa7ff24ca899b0f1036d0e6a3b/users/5d19942e971b4d7fac3ab8f9a5ad6086/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.033793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 801/1607] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:00 2022] PUT /identity/v3/projects/8af34fa3679e4dacafe5402b1520a70c/users/ea99e631ab594cd889a62ab1c61cb5e0/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.034389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.034846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.101817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.105587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed9b7-5583-4625-be5f-e32bf90324a8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.111948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.112921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.112921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.113114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] PATH_INFO: `/v3/projects/782a2f5efd3f44b0ba01b2a22d3702f8/users/fbd43b05f56b43b4a04d3b6caba1b828/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.113939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5200-e30f-4ad2-9d8d-32d914856335 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.125663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.127080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.127387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.127817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] PATH_INFO: `/v3/projects/df183dcb596949d6b6eada0fa5aab08f/users/b6fd66138d0a418f877bb146ba9b59fe/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.130339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782a2f5efd3f44b0ba01b2a22d3702f8, user_id=fbd43b05f56b43b4a04d3b6caba1b828, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.133224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.148894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 807/1608] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:01 2022] PUT /identity/v3/projects/782a2f5efd3f44b0ba01b2a22d3702f8/users/fbd43b05f56b43b4a04d3b6caba1b828/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.150452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.155762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df183dcb596949d6b6eada0fa5aab08f, user_id=b6fd66138d0a418f877bb146ba9b59fe, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.158751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e372b-7317-4994-ac71-b4bce57fde80 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.177798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 802/1609] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:01 2022] PUT /identity/v3/projects/df183dcb596949d6b6eada0fa5aab08f/users/b6fd66138d0a418f877bb146ba9b59fe/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.179818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104337-35eb-4ec8-966e-70174570e9c1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.180083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104337-35eb-4ec8-966e-70174570e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.180368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104337-35eb-4ec8-966e-70174570e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.213386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-05104337-35eb-4ec8-966e-70174570e9c1 None None] MFA Rules not processed for user `c9d2254c24884aafa36824feb2a95fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.214628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-05104337-35eb-4ec8-966e-70174570e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.236716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5f8b-e0dd-4b40-b210-4341157a6b69 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.281556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.306970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 803/1610] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.306970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fb48-2ad9-44a8-8e9f-056ab95bba45 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.306970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fb48-2ad9-44a8-8e9f-056ab95bba45 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.306970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fb48-2ad9-44a8-8e9f-056ab95bba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.321239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.322384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.323008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.323008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] PATH_INFO: `/v3/projects/6b91060d27d543f4b24dd0b6c2300722/users/4bca36b1001c409fa0c9086c10bce9b4/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.331809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e247fb48-2ad9-44a8-8e9f-056ab95bba45 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.334149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e247fb48-2ad9-44a8-8e9f-056ab95bba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.342161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b91060d27d543f4b24dd0b6c2300722, user_id=4bca36b1001c409fa0c9086c10bce9b4, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.348124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 804/1611] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.349093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad6b0e-418f-4e74-ac4b-d229ab6fa006 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.350787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b725-5a4c-47f2-8584-47da490477f2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.351720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b725-5a4c-47f2-8584-47da490477f2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.352409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b725-5a4c-47f2-8584-47da490477f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.374362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ac67b725-5a4c-47f2-8584-47da490477f2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.376034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 808/1612] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:01 2022] PUT /identity/v3/projects/6b91060d27d543f4b24dd0b6c2300722/users/4bca36b1001c409fa0c9086c10bce9b4/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.376194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ac67b725-5a4c-47f2-8584-47da490477f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.385040 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.385345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.385593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.422119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] MFA Rules not processed for user `ea99e631ab594cd889a62ab1c61cb5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.424721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.451283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 805/1613] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.452782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.453076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.453347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.488316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] MFA Rules not processed for user `fbd43b05f56b43b4a04d3b6caba1b828`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.489560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.510060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 809/1614] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.515059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.522660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343dc6-d7d5-4377-a603-11c66e634b3b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.528735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.529727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.529924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.530197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.530945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.532758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.546932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 810/1615] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:01.549502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.565371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89289034-52cc-436d-80fd-c81a814bf03a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.572630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.573512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.574133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.574391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.575453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.578504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d172f4-7112-4108-bcc9-74d97f37e94c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.581081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.611406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 806/1616] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.612478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.625192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 811/1617] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:01.626518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.628051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.628342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.672050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] MFA Rules not processed for user `4bca36b1001c409fa0c9086c10bce9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:01.673836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:01.689499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cde92-fc1e-4de8-85c3-24d2841920e0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.776324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 812/1618] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:01.777250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.790708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.793356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.793646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.794200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.795381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.883181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef11a-c2c8-42c3-be42-5caf55f194fa None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.887507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.888310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.888593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.888899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.889031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.890500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.899699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.901198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 807/1619] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:01.901718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb3e2-fdde-4a07-8617-2e9f287992c5 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.901815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.911043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b8c55-35e6-46d6-9e97-ad6995467811 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.912342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 813/1620] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:01.913735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65a46-bfb7-4c7d-8a70-660914e6c48c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.914015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65a46-bfb7-4c7d-8a70-660914e6c48c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.914306 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65a46-bfb7-4c7d-8a70-660914e6c48c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.915592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 814/1621] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 26 12:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:01.916383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd65a46-bfb7-4c7d-8a70-660914e6c48c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.918472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.919477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.921273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.921562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] PATH_INFO: `/v3/projects/df183dcb596949d6b6eada0fa5aab08f/users/b6fd66138d0a418f877bb146ba9b59fe/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.925536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df183dcb596949d6b6eada0fa5aab08f, user_id=b6fd66138d0a418f877bb146ba9b59fe, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.929475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be666422-4f5a-4498-a7ac-3f7b83c7830d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.929648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd65a46-bfb7-4c7d-8a70-660914e6c48c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:01.934576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:01.935015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.935377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.935697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.936389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:01.938657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850fc8d-5af4-4ee1-8ffd-aee227b3b936 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:01.948881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 808/1622] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:01 2022] PUT /identity/v3/projects/df183dcb596949d6b6eada0fa5aab08f/users/b6fd66138d0a418f877bb146ba9b59fe/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:01.950702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10062281-bf1c-46be-8df7-d592dc78cf25 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.951476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10062281-bf1c-46be-8df7-d592dc78cf25 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.951476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10062281-bf1c-46be-8df7-d592dc78cf25 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.953657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 809/1623] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 26 12:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:01.954644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10062281-bf1c-46be-8df7-d592dc78cf25 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:01.977668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 815/1624] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:01.977668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e4c5-62a8-43a6-b1f3-2cb4c572033e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:01.977668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e4c5-62a8-43a6-b1f3-2cb4c572033e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:01.978354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e4c5-62a8-43a6-b1f3-2cb4c572033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:01.999816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e6c7e4c5-62a8-43a6-b1f3-2cb4c572033e None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:02.001587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e6c7e4c5-62a8-43a6-b1f3-2cb4c572033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:02.020744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:02.040298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10062281-bf1c-46be-8df7-d592dc78cf25 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.044949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.045830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.046223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.046569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.091715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 816/1625] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 26 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:02.093220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.093580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.093922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.112713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.113713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:02.114408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc5fb-c4fa-4b3b-b86a-90ba759e7ba5 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.115101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:02.126252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 810/1626] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:02.128081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.128437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.128787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.135631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 817/1627] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:02.140866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.163051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] MFA Rules not processed for user `b6fd66138d0a418f877bb146ba9b59fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:02.165491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:02.232593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7aca9-26e8-484c-8cee-5ee0e3fa322b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.242457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.243765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.244347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.245411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.247563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.252994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.276894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 818/1628] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:02.278099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.279455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 811/1629] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:02.281342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.307407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0647e-fe95-449a-a740-117b3c9fa6b5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.313852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b0b4-e139-4b43-aedd-7c4146f650cf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.315237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.316217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.316849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.317270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.330822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.331665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:02.331805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.332063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.332393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.416604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.418616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.449858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 812/1630] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:02.450879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.464258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.466243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.479922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4e0c5-46a8-4687-8fef-0858fdf58769 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.486889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 819/1631] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:02.488200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.496799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.497740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.498023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.498298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] PATH_INFO: `/v3/projects/cbfd7e746a1d4459b16336059be2f416/users/f98e3c5a3a584c65ad20a9bc629bde31/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.504856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55b55-7db6-4bf0-a251-b691c8ccb36f service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.514970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.517900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.518188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.518482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.531930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfd7e746a1d4459b16336059be2f416, user_id=f98e3c5a3a584c65ad20a9bc629bde31, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.536733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.544120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.545581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.559799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:02.574158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 820/1632] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:02.586854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 813/1633] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:02 2022] PUT /identity/v3/projects/cbfd7e746a1d4459b16336059be2f416/users/f98e3c5a3a584c65ad20a9bc629bde31/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:02.590555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.609255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823643-80c6-4b3a-9d4b-d84374a27fc7 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.747302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.748199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.748576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.748940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.749815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.751776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0222a-0809-410b-9388-c64b245a7cb2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.797320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.810747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 821/1634] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:02.811432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3459a-5410-45fc-8bba-be6e2c77d239 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:02.826878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:02.828047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.828331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.828605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] PATH_INFO: `/v3/projects/cbfd7e746a1d4459b16336059be2f416/users/f98e3c5a3a584c65ad20a9bc629bde31/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.835633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfd7e746a1d4459b16336059be2f416, user_id=f98e3c5a3a584c65ad20a9bc629bde31, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:02.838385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:02.869621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 814/1635] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:02 2022] PUT /identity/v3/projects/cbfd7e746a1d4459b16336059be2f416/users/f98e3c5a3a584c65ad20a9bc629bde31/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:02.880927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a333-6283-4a0e-b83a-e79fd9118147 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:02.881211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a333-6283-4a0e-b83a-e79fd9118147 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:02.881604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a333-6283-4a0e-b83a-e79fd9118147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:02.932637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:02.977623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6541a333-6283-4a0e-b83a-e79fd9118147 None None] MFA Rules not processed for user `f98e3c5a3a584c65ad20a9bc629bde31`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:02.979749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6541a333-6283-4a0e-b83a-e79fd9118147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.138299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e66d7-5b6e-49c4-90c6-608d02b72122 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:03.146627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:03.148271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.150043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.150507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] PATH_INFO: `/v3/users/cc3a199952bc4b46838ecff13ee10e94` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.152476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3a199952bc4b46838ecff13ee10e94)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:03.155164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:03.228947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 822/1636] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:03.230670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb136-fc2b-4f39-b357-0c2b871bc6bf None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.230965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb136-fc2b-4f39-b357-0c2b871bc6bf None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.231343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb136-fc2b-4f39-b357-0c2b871bc6bf None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.238384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 823/1637] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 26 12:38:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:03.239443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb136-fc2b-4f39-b357-0c2b871bc6bf None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:03.243161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3a199952bc4b46838ecff13ee10e94'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:03.245688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3a199952bc4b46838ecff13ee10e94'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:03.263900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:03.268167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3a199952bc4b46838ecff13ee10e94'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:03.282201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3a199952bc4b46838ecff13ee10e94'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:03.282984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9f1cff65-ce5c-4c27-bf25-fce44d102903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3a199952bc4b46838ecff13ee10e94'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:03.321752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 815/1638] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:02 2022] DELETE /identity/v3/users/cc3a199952bc4b46838ecff13ee10e94 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:03.324381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bda5-f11b-499a-aaaa-0ca71faac183 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.324887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bda5-f11b-499a-aaaa-0ca71faac183 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.326660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bda5-f11b-499a-aaaa-0ca71faac183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.347359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb136-fc2b-4f39-b357-0c2b871bc6bf None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:03.355171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bc30bda5-f11b-499a-aaaa-0ca71faac183 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:03.356494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bc30bda5-f11b-499a-aaaa-0ca71faac183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.444979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:03.445984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.446520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.447015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.455014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.499316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:03.559787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 816/1639] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:38:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:03.564926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256db0-1dcd-4efa-a80e-ea3e5421586f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.565389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256db0-1dcd-4efa-a80e-ea3e5421586f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.567885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256db0-1dcd-4efa-a80e-ea3e5421586f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.569559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 817/1640] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 26 12:38:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:03.577601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.577879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.578157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.659210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:03.661676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.704480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:03.706193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b92c5-2878-4f19-800b-2e6afe674d67 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:03.731823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 824/1641] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:03.733593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.734171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.736876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.772118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:03.773769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.808444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 818/1642] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:03.808981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 825/1643] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:38:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:03.811743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:03.815130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.835275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34235-7694-4b12-9a2a-7ad22286bd81 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:03.852582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:03.854538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.862591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:03.863271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.863584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.863844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.877358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d006cb-5a43-4a1d-8beb-6d5247e98ce8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:03.886090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:03.886807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:03.887084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:03.887356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:03.901272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:03.902666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:03.917887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:03.922168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:03.934128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 819/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:03.941506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:03.946099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:03.963277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 826/1645] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:04.044236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853354-3ce4-4619-bfa0-1430dfb14ac6 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:04.047477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:04.048081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:04.048368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:04.048626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:04.073250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:04.074709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c68ebe-6fd9-48fa-97b7-767fc71e26f0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:04.102509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 820/1646] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:04.687005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:04.698849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed74b4-5b74-4df9-8b0a-c0b278208ab3 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:04.715321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:04.716607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:04.717145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:04.717880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:04.722447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:04.762694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:04.762986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:04.763338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:04.822259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] MFA Rules not processed for user `5d19942e971b4d7fac3ab8f9a5ad6086`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:04.823594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:04.920806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:04.923324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ed32f-3ded-40c6-b9b4-13182c885bf8 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:04.957192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 827/1647] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:05.008529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 821/1648] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:05.022022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:05.022716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:05.023336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:05.033326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:05.072743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] MFA Rules not processed for user `5d19942e971b4d7fac3ab8f9a5ad6086`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:05.075115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:05.097891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 828/1649] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:05.112722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:05.115111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:05.163199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3abbd1-7d89-474b-8fe6-afae30ee1e05 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:05.174344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:05.186013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:05.187709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:05.188666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:05.213225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:05.217503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:05.222361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:05.264502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 822/1650] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:05.362066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:05.363610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:05.393646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593507f-1fd8-4dcb-a52c-061f3a8adc4a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:05.404382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:05.405279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:05.405614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:05.405888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] PATH_INFO: `/v3/projects/d0f836a599084f8d9dc754f766a86332` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:05.408192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f836a599084f8d9dc754f766a86332)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:05.415644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:05.547852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f836a599084f8d9dc754f766a86332', 'request_id': 'req-3937dbbd-4a24-473e-a7a8-b8492ea9b071'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.556893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f836a599084f8d9dc754f766a86332', 'request_id': 'req-3937dbbd-4a24-473e-a7a8-b8492ea9b071'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.563661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f836a599084f8d9dc754f766a86332', 'request_id': 'req-3937dbbd-4a24-473e-a7a8-b8492ea9b071'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.581849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] The token cache is being invalidate because project d0f836a599084f8d9dc754f766a86332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:05.582957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.584068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3937dbbd-4a24-473e-a7a8-b8492ea9b071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.587105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 829/1651] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:05 2022] DELETE /identity/v3/projects/d0f836a599084f8d9dc754f766a86332 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:05.592234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:05.611902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e465-9e8f-41ab-bf62-46425484c494 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:05.750054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:05.750957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:05.751236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:05.751501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] PATH_INFO: `/v3/users/b6fd66138d0a418f877bb146ba9b59fe` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:05.753586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fd66138d0a418f877bb146ba9b59fe)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:05.755561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:05.864302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fd66138d0a418f877bb146ba9b59fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.865758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fd66138d0a418f877bb146ba9b59fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.883020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fd66138d0a418f877bb146ba9b59fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.911509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fd66138d0a418f877bb146ba9b59fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.913078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7ad5206a-ad77-47d7-9d2c-3b3e188f18df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fd66138d0a418f877bb146ba9b59fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:05.940282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 823/1652] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:05 2022] DELETE /identity/v3/users/b6fd66138d0a418f877bb146ba9b59fe => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:06.132428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:06.132428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:06.132428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:06.132428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 830/1653] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 26 12:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:06.133298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:06.133298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:06.133298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:06.245853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:06.247268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:06.402333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 824/1654] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:06.422578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:06.424828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:06.454194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6a3f-1a26-4d24-bdc2-bc99ceb76948 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:06.459527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:06.460593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:06.461004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:06.461405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:06.480470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:06.482298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248f57d-2e5b-4046-a75a-324edf9440f7 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:06.503563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 831/1655] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:07.317731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:07.320681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:07.348098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:07.525072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e426316-5eaa-4a74-93a5-daaa719cd938 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:07.540923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:07.542091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:07.542591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:07.543363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] PATH_INFO: `/v3/projects/df183dcb596949d6b6eada0fa5aab08f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:07.545053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df183dcb596949d6b6eada0fa5aab08f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:07.546124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b08ab8-e3e7-42e7-905e-d71ef7b839e0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:07.546588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b08ab8-e3e7-42e7-905e-d71ef7b839e0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:07.546891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b08ab8-e3e7-42e7-905e-d71ef7b839e0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:07.547220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:38:07.547220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: warnings.warn(msg) May 26 12:38:07.547220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: May 26 12:38:07.548664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 832/1656] 10.222.0.75 () {54 vars in 960 bytes} [Thu May 26 12:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:07.553236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:07.561706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:07.563869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:07.564243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:07.598331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:07.600806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:07.738020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df183dcb596949d6b6eada0fa5aab08f', 'request_id': 'req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:07.768512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df183dcb596949d6b6eada0fa5aab08f', 'request_id': 'req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:07.790247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df183dcb596949d6b6eada0fa5aab08f', 'request_id': 'req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:07.811945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] The token cache is being invalidate because project df183dcb596949d6b6eada0fa5aab08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:07.812368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:07.816166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f11c7e10-4dc0-4666-8af6-ce2f1d1c1535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:07.818328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 825/1657] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:07 2022] DELETE /identity/v3/projects/df183dcb596949d6b6eada0fa5aab08f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:07.827518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87624a-2c85-456b-a561-cd6527a9ee75 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:07.827518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87624a-2c85-456b-a561-cd6527a9ee75 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:07.827518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87624a-2c85-456b-a561-cd6527a9ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:07.850578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5a87624a-2c85-456b-a561-cd6527a9ee75 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:07.852539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5a87624a-2c85-456b-a561-cd6527a9ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:07.858182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 833/1658] 10.222.0.75 () {58 vars in 1057 bytes} [Thu May 26 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:07.868133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:07.894488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef63d-a766-401b-a92f-4e0688225ec6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.014829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 826/1659] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:08.024847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.029587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.036151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.112383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:08.118959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:08.119264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:08.142278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.143212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.143493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.143854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.153847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:08.158890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 827/1660] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:08.159768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.175441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.182116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199009e-cb3f-48d5-b38d-60fa9f5fa533 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.185373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.192155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.192873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.193153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.193435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.194357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:08.194646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.196367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.222796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 834/1661] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:08.233244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 828/1662] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:08.250314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.284825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c53b-9967-4d41-8ea3-a824cdc1c8bf service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.299881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.300574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.300859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.301137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.301843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.303889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.391107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 835/1663] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:08 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:08.395369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.412759 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fc8a-36a6-4ae0-9a91-5582fdb15848 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.478450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:08.592975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.593694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.593980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.594266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.594988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.597531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.646500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 829/1664] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:08 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:08.648266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.663420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca989db-c8c0-4adc-b485-1bd9f4eea336 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.678733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.680035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.680134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.680411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.681329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.684984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.714918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 836/1665] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:08.715171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.729543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002495-d11c-4eb1-85f1-79dad35a02de admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.758717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.761002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.761363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.761555 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.767762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.769650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c224e5-6319-408e-9c62-53d41d665ea4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.796491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 830/1666] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:08.800611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:08.820767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7ac7-72e3-4e78-83c8-0a9aaa2cbc12 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:08.828552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:08.829709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.830187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.830636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] PATH_INFO: `/v3/projects/71fe5eb35d9a4301837cdac410abddf4/users/be71a853983e47f3a8aef95f7d68e516/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.881565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fe5eb35d9a4301837cdac410abddf4, user_id=be71a853983e47f3a8aef95f7d68e516, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:08.884863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:08.937838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:08.937838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:08.938076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:08.938885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 837/1667] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:08 2022] PUT /identity/v3/projects/71fe5eb35d9a4301837cdac410abddf4/users/be71a853983e47f3a8aef95f7d68e516/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:09.034449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] MFA Rules not processed for user `be71a853983e47f3a8aef95f7d68e516`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:09.036429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:09.257529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 831/1668] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:09.257721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:09.359822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ee56-381a-4133-a465-e1628b8b9b51 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:09.374483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:09.376309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:09.376862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:09.377155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:09.377866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:09.381754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:09.454601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 838/1669] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:09 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:09.455560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:09.484136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8b97-0085-4783-9582-877e785c75b3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:09.995426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:09.996193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:09.996472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:09.996745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:09.999186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.003844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad6bc4-9a9c-489e-af3a-e2be013521da admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.056415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.064899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 832/1670] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:09 2022] POST /identity/v3/users => generated 293 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:10.072167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2163-b8e0-442a-9008-e7eb48f6d23a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.084370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.085288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.085671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.087657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.088889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.096705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.110296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.110296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.110296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.136350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 839/1671] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:10.137320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.165811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a498-494a-4b15-a4fa-ae4f183ccfe5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.179891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] MFA Rules not processed for user `e811736979c44b02b14fecb74c6bd7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:10.181110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.183159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.184107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.184364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.185972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] PATH_INFO: `/v3/projects/1d892ba4f77e4080800fdb2e52d0a564/users/0120fd0112c54d65966b3e3b7a951e1d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.205459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:10.217076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d892ba4f77e4080800fdb2e52d0a564, user_id=0120fd0112c54d65966b3e3b7a951e1d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.221074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.253034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 840/1672] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:10 2022] PUT /identity/v3/projects/1d892ba4f77e4080800fdb2e52d0a564/users/0120fd0112c54d65966b3e3b7a951e1d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:10.253977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.295690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 833/1673] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:10.310631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.311984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.325779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:10.361003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f64ee-195a-41ca-90eb-6f28c0224346 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.370588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.371276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.371560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.371838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.372574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.374197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.400926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 841/1674] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:10.406346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.431721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178901d-40bf-44df-b4fd-b69bbcbd1e01 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.433916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bedfd-937b-4661-9c54-45499d6b97e6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.437856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.439023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.439614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.440080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] PATH_INFO: `/v3/projects/1d892ba4f77e4080800fdb2e52d0a564/users/0120fd0112c54d65966b3e3b7a951e1d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.442363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d892ba4f77e4080800fdb2e52d0a564, user_id=0120fd0112c54d65966b3e3b7a951e1d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.450552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb967580-80ff-4b69-b4eb-14aba21591a8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.472725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 842/1675] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:10 2022] PUT /identity/v3/projects/1d892ba4f77e4080800fdb2e52d0a564/users/0120fd0112c54d65966b3e3b7a951e1d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:10.476476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.476614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.476891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.511669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] MFA Rules not processed for user `0120fd0112c54d65966b3e3b7a951e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:10.513416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.543991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.545073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.545461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.545834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.611683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 843/1676] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:10.623815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.626811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.629884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:10.651911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.654141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.670439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 834/1677] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:10.729461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6196e-7ea1-40d3-8410-c71ccad8e3d9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.733816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.734591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.734965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.735357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.747991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.750004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1885b-a29f-4cbb-b4b7-dc91f40415dd service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.776324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 844/1678] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:11.611505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:11.631117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492f56-2a72-449d-bb4a-0fe7b9c6f589 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:11.761391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:11.763231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:11.763739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:11.764713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] PATH_INFO: `/v3/users/be71a853983e47f3a8aef95f7d68e516` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:11.766338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be71a853983e47f3a8aef95f7d68e516)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:11.770032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:11.860427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be71a853983e47f3a8aef95f7d68e516'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:11.862617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be71a853983e47f3a8aef95f7d68e516'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:11.877613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be71a853983e47f3a8aef95f7d68e516'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:11.915387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be71a853983e47f3a8aef95f7d68e516'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:11.916561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be71a853983e47f3a8aef95f7d68e516'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:11.953230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d7442-ead5-40fa-bb48-a97f9cb9edd6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:11.953762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d7442-ead5-40fa-bb48-a97f9cb9edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:11.953762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d7442-ead5-40fa-bb48-a97f9cb9edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:11.955128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 835/1679] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:11 2022] DELETE /identity/v3/users/be71a853983e47f3a8aef95f7d68e516 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:11.983447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-962d7442-ead5-40fa-bb48-a97f9cb9edd6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:11.984718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-962d7442-ead5-40fa-bb48-a97f9cb9edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:12.093329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:12.120689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 845/1680] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:12.150939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:12.156863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:12.347792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99b78-594b-4cbe-be62-c3e8c81f4c33 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:12.358710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:12.359472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:12.359786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:12.360064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:12.388704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:12.390660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaf5b4-f4c6-4691-9058-d14199da40d3 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:12.432800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 836/1681] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:12.602467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:12.602744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:12.603025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:12.660238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] MFA Rules not processed for user `0431b1f25497443ba483b3c440669080`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:12.666755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:12.928641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 846/1682] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:12.929049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:12.929569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:12.930430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:12.961928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] MFA Rules not processed for user `0431b1f25497443ba483b3c440669080`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:12.964640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:12.986682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 837/1683] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:12.997444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.001113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.152902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.154408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.174812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:13.192682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf05e-3a8f-4323-a220-b2972532ff60 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.208625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b538b-ed46-4381-acc3-31b918a2dc0f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.217319 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.218394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.218896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.219257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] PATH_INFO: `/v3/projects/71fe5eb35d9a4301837cdac410abddf4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.220656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fe5eb35d9a4301837cdac410abddf4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.222850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.246207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.248675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.249208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.249855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.283700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.290146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.324457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 847/1684] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:13.383015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fe5eb35d9a4301837cdac410abddf4', 'request_id': 'req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.411812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fe5eb35d9a4301837cdac410abddf4', 'request_id': 'req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.428011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fe5eb35d9a4301837cdac410abddf4', 'request_id': 'req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.452762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] The token cache is being invalidate because project 71fe5eb35d9a4301837cdac410abddf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:13.453410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.455295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-901dd43c-c31d-40c3-8505-c05ee2ea6d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.462384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.463287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 838/1685] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:13 2022] DELETE /identity/v3/projects/71fe5eb35d9a4301837cdac410abddf4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:13.480128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa06b0f-e42a-4f36-8f1c-801553b19f1b service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.675086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.676157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.676445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.676756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] PATH_INFO: `/v3/users/0120fd0112c54d65966b3e3b7a951e1d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.678235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0120fd0112c54d65966b3e3b7a951e1d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.681345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: WARNING py.warnings [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:38:13.681345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: warnings.warn(msg) May 26 12:38:13.681345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: May 26 12:38:13.690965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.714984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:13.900059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0120fd0112c54d65966b3e3b7a951e1d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.904876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0120fd0112c54d65966b3e3b7a951e1d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.907339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0120fd0112c54d65966b3e3b7a951e1d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:13.977057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0120fd0112c54d65966b3e3b7a951e1d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:14.008959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e289b3e-deaa-491e-a5db-bedf0c82339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0120fd0112c54d65966b3e3b7a951e1d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:14.040049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 848/1686] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:13 2022] DELETE /identity/v3/users/0120fd0112c54d65966b3e3b7a951e1d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:14.409838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac6d9-1c74-4a33-a078-9179ee1908e3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.410395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac6d9-1c74-4a33-a078-9179ee1908e3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.410475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac6d9-1c74-4a33-a078-9179ee1908e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.453043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ca4ac6d9-1c74-4a33-a078-9179ee1908e3 None None] MFA Rules not processed for user `e811736979c44b02b14fecb74c6bd7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:14.455428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ca4ac6d9-1c74-4a33-a078-9179ee1908e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:14.587229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 839/1687] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:14.615336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773240-9b45-4db5-adbb-7eb66726a303 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.615716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773240-9b45-4db5-adbb-7eb66726a303 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.615925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773240-9b45-4db5-adbb-7eb66726a303 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.617382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 849/1688] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 26 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:14.624941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.625655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.626140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.656442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:14.658908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:14.761532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.762288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.762646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.805881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:14.809812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:14.810143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 840/1689] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:14.879793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:14.882611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:14.896032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c39d-4015-4c25-afff-0575be7cb97e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:14.926270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:14.927129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.928715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.929195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.949072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:14.951210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 850/1690] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:14.954513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:15.003862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 841/1691] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:15.189389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:15.191852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:15.311824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53702-8f10-4417-9d95-e0f32553ce62 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:15.324245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:15.325082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:15.325517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:15.325770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:15.334167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:15.335879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:15.336050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:15.337696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787f67d-9b08-4766-a969-16ef70f1fba3 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:15.347296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 851/1692] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:38:15.426102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:15.530479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199983c-3e26-4fc1-a8d1-2bc718bd8b1b service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:15.548514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:15.549444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:15.549724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:15.550020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] PATH_INFO: `/v3/projects/1d892ba4f77e4080800fdb2e52d0a564` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:15.551274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d892ba4f77e4080800fdb2e52d0a564)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:15.553387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:15.674284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d892ba4f77e4080800fdb2e52d0a564', 'request_id': 'req-496eb189-2c71-4d05-be52-0ba4038f43e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:15.692204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d892ba4f77e4080800fdb2e52d0a564', 'request_id': 'req-496eb189-2c71-4d05-be52-0ba4038f43e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:15.717539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d892ba4f77e4080800fdb2e52d0a564', 'request_id': 'req-496eb189-2c71-4d05-be52-0ba4038f43e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:15.747150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] The token cache is being invalidate because project 1d892ba4f77e4080800fdb2e52d0a564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:15.747470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:15.752505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-496eb189-2c71-4d05-be52-0ba4038f43e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:15.759183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 842/1693] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:15 2022] DELETE /identity/v3/projects/1d892ba4f77e4080800fdb2e52d0a564 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:15.761163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:15.761455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:15.761738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:15.813298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:15.814658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:15.864196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:16.037823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 852/1694] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:16.040979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.041379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.041920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.094481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:16.104235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.153321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 843/1695] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:16.157089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.168978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4736-77c5-4fa0-ac20-af088a556d86 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.187101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:16.187881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.188333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.188913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.189882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:16.190809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:16.193965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:16.230235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.240829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 853/1696] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:16.243847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b970c9b-e98c-458f-8728-6b7c1d7186d1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.271561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.271561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.275252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:16.284641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.285094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.285378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.293317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:16.302562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:16.315925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828254a-4740-4000-8846-c0ec567c810d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.338327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:16.340696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.344008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.345135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] PATH_INFO: `/v3/users/ea99e631ab594cd889a62ab1c61cb5e0` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.352421 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea99e631ab594cd889a62ab1c61cb5e0)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:16.363697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:16.397002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 844/1697] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:16.398015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.543426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea99e631ab594cd889a62ab1c61cb5e0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:16.544416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea99e631ab594cd889a62ab1c61cb5e0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:16.545456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea99e631ab594cd889a62ab1c61cb5e0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:16.583198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea99e631ab594cd889a62ab1c61cb5e0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:16.596553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b807eb21-a4f0-4c74-94e9-11f29ea79f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea99e631ab594cd889a62ab1c61cb5e0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:16.632947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 854/1698] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:16 2022] DELETE /identity/v3/users/ea99e631ab594cd889a62ab1c61cb5e0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:16.640231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd893-ae70-4788-91d4-43a578966df1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.642334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd893-ae70-4788-91d4-43a578966df1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.643711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd893-ae70-4788-91d4-43a578966df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.720116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f07dd893-ae70-4788-91d4-43a578966df1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:16.723148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f07dd893-ae70-4788-91d4-43a578966df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.728703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab34f-f57e-48be-946b-906627c38def admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.868524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:16.976772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 855/1699] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:16.976772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.976772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.979449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.033883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] MFA Rules not processed for user `0431b1f25497443ba483b3c440669080`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:17.040295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:17.055731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.056449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.056789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.057066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.057784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.080081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.102326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:17.189313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 845/1700] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/users => generated 282 bytes in 791 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:17.195194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:17.204531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:17.344605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 856/1701] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:17.346650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:17.363039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:17.429327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc9606-768a-47e8-be5a-f00a7d739155 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:17.452881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.453587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.454005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.454186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.454948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.456805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.481791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 857/1702] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:17.483109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:17.515582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6861-b7f0-4b95-9477-e7f738057483 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:17.530906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.531630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.532651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.532940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.534035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.535375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2a7a-174d-4154-a3d8-d1581e8883d6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.547578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7704-b86d-4f6b-96e4-34903b1b7c22 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:17.552019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.553986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.554522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.554989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.567770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.570563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.583751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 846/1703] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:17.599275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 858/1704] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:17.613166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:17.629583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a6834-1450-40e7-a3f2-194bc2ee543c service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:17.640364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.642116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.643490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.645080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] PATH_INFO: `/v3/projects/33b3891521c34f90a2422d31582950da/users/a7c5b19ce8704770be8b3790ec6f0901/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.709431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b3891521c34f90a2422d31582950da, user_id=a7c5b19ce8704770be8b3790ec6f0901, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.717064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.771130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 847/1705] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:17 2022] PUT /identity/v3/projects/33b3891521c34f90a2422d31582950da/users/a7c5b19ce8704770be8b3790ec6f0901/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:17.777808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.778106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.778386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.868979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] MFA Rules not processed for user `a7c5b19ce8704770be8b3790ec6f0901`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:17.872355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.002532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 859/1706] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:18.007593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.155219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aef05-3781-406a-8e13-72ace49063fe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.174620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.176429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.176740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.177036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.178180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.183571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.186241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.188900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.241627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 848/1707] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:18.251244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdb59-e507-4ff1-927d-5323c0ab2205 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.252807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.351575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:18.420743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd6ed-aec7-4bce-a0a5-2c76d624a0dc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.435082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.435827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.436289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.436491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.437255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.437372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.437663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.438190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] PATH_INFO: `/v3/projects/8af34fa3679e4dacafe5402b1520a70c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.438510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.440741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.441815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af34fa3679e4dacafe5402b1520a70c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.443997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.479699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 849/1708] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:18.483446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.501766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efea6a9-c793-4aba-988c-47ae1bbed075 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.509318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.510338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.510821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.511274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.512289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.514182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.550094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 850/1709] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:18.550094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.570524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb485-c944-4c5b-ad5b-659344c8068d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.578542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:18.598831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af34fa3679e4dacafe5402b1520a70c', 'request_id': 'req-b4a723c1-2e64-4129-b9b7-03859e2b3759'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:18.611380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af34fa3679e4dacafe5402b1520a70c', 'request_id': 'req-b4a723c1-2e64-4129-b9b7-03859e2b3759'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:18.626381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af34fa3679e4dacafe5402b1520a70c', 'request_id': 'req-b4a723c1-2e64-4129-b9b7-03859e2b3759'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:18.661590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] The token cache is being invalidate because project 8af34fa3679e4dacafe5402b1520a70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:18.662035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:18.663205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b4a723c1-2e64-4129-b9b7-03859e2b3759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:18.665635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 860/1710] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:18 2022] DELETE /identity/v3/projects/8af34fa3679e4dacafe5402b1520a70c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:18.670568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429576-795c-47ab-9380-144f8f06034a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.670852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429576-795c-47ab-9380-144f8f06034a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.671112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429576-795c-47ab-9380-144f8f06034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.727548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-33429576-795c-47ab-9380-144f8f06034a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:18.734280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-33429576-795c-47ab-9380-144f8f06034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.759252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.760596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.761129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.761732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] PATH_INFO: `/v3/projects/2b45f684546c47fb9517e9fb8df7e331/users/94c7b0566bbc4778aa4f39022b59bb15/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.796282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b45f684546c47fb9517e9fb8df7e331, user_id=94c7b0566bbc4778aa4f39022b59bb15, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.799268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.837969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 851/1711] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:18 2022] PUT /identity/v3/projects/2b45f684546c47fb9517e9fb8df7e331/users/94c7b0566bbc4778aa4f39022b59bb15/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:18.842140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.845014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.931931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 861/1712] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:18.939797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.948401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.948824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.992960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396e89-5f30-4ee9-8c65-dc0b9cb846e0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.996924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:18.998226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.998403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.999195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.999569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.000421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.002052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.004326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.020403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 852/1713] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:19.022024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.031857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 862/1714] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:19.033400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.042178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e1ec4-a70b-4f4d-974d-4b99c6049a5a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.048079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.048424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd88a-0551-438c-a08d-f9b1062896d8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.048997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.049336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.049690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] PATH_INFO: `/v3/projects/2b45f684546c47fb9517e9fb8df7e331/users/94c7b0566bbc4778aa4f39022b59bb15/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.052076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b45f684546c47fb9517e9fb8df7e331, user_id=94c7b0566bbc4778aa4f39022b59bb15, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.053873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.054839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.055050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa7ed-6e7d-423b-889f-5eab98ed09da admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.055304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.055717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.056576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:19.057049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.058800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.070097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 853/1715] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:19 2022] PUT /identity/v3/projects/2b45f684546c47fb9517e9fb8df7e331/users/94c7b0566bbc4778aa4f39022b59bb15/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:19.082138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.082659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.083107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.086717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 863/1716] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:19.087619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.098747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200605be-8fa7-41ef-b758-d07b329f3b9c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.123673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:19.128448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] MFA Rules not processed for user `94c7b0566bbc4778aa4f39022b59bb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:19.132163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:19.198533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.199827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.200264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.200559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.201387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.203354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.242047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 864/1717] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:19.253963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.260727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 854/1718] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:19.276928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.280074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:19.350041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b57984-55cd-4913-a963-1ebc45ac9e3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.357056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:19.466148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0876397-f413-4925-8fa3-23e42f79123b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.478069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.478985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.480627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.480739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.480739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.498672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.498867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.499837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.500715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.506740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.563259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 865/1719] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:19.564585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.590046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb05d-d31e-491f-ba12-7305e44bb62d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.602467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.605412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.605738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.609797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.610920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.612696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.645079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 866/1720] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:19.646602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.671503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75327be5-6219-4292-9063-71fe8d28fe7b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.673247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.675192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.685702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.686404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.686931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.687283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.690355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.692125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f500c-a27d-41ef-bc2a-6754194fd618 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.702136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 855/1721] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:19.710418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 867/1722] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:19.714772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.721460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:19.726139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56faf25-ae96-4ab1-aba8-e53feebfba78 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.731933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.732903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.733279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.733601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] PATH_INFO: `/v3/projects/09c3cfa4825a437b924f3d94ab07cd02/users/55fc573e003542929754b30458301e5b/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.753199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c3cfa4825a437b924f3d94ab07cd02, user_id=55fc573e003542929754b30458301e5b, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.761678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.800874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.801556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.803255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.822324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 856/1723] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:19 2022] PUT /identity/v3/projects/09c3cfa4825a437b924f3d94ab07cd02/users/55fc573e003542929754b30458301e5b/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:19.834867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.880978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] MFA Rules not processed for user `55fc573e003542929754b30458301e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:19.882270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:19.961542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad708f-6d4e-4c58-b893-fd8c56fd9e58 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.977591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.978456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.978779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.979175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.985635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.053932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 868/1724] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:20.059809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.105418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.106884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.122772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 857/1725] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:20.221310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116485b2-7fc8-41d8-be07-e2c05bd0cf93 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.227376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.228895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.229357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.229968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.230993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.233358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.283726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.291967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 869/1726] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:20 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:20.304687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66304c-499d-45d6-8ebb-92ef9763c9b8 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.389370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.390096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.390382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.390650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.391359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.393330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.418763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 858/1727] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:20 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:20.422572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.433870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8a696-a5cc-49e7-8ec1-5147d9702982 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.438955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.439751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.440103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.440469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.441272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.443456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.455756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 870/1728] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:20.459985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.470197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7271-f2fd-4a05-b54e-ef386c9f54ac admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.482920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.484040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.484320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.484592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] PATH_INFO: `/v3/projects/73601a40f54b4d30ab64a73302abde83/users/b25bb93eb6b9404f98c7e4fcd0c8999d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.500618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73601a40f54b4d30ab64a73302abde83, user_id=b25bb93eb6b9404f98c7e4fcd0c8999d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.503291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.513563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:20.518656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 859/1729] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:20 2022] PUT /identity/v3/projects/73601a40f54b4d30ab64a73302abde83/users/b25bb93eb6b9404f98c7e4fcd0c8999d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:20.522785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.529570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:20.534245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f7011-913f-411b-b0b0-2c8c7aee2668 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.612025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.612697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.612980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.613240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.613967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.615935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c87788-59c7-4023-bc5c-cc36d214a3bc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.629860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 871/1730] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:20.634711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.649897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c18f8-5350-4bb1-a487-2210a281d9d7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.655289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.656247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.656522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.656788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] PATH_INFO: `/v3/projects/73601a40f54b4d30ab64a73302abde83/users/b25bb93eb6b9404f98c7e4fcd0c8999d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.658847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=73601a40f54b4d30ab64a73302abde83, user_id=b25bb93eb6b9404f98c7e4fcd0c8999d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.661657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.672767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 860/1731] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:20 2022] PUT /identity/v3/projects/73601a40f54b4d30ab64a73302abde83/users/b25bb93eb6b9404f98c7e4fcd0c8999d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:20.683578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.683844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.684122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.713070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] MFA Rules not processed for user `b25bb93eb6b9404f98c7e4fcd0c8999d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:20.714276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.791528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 872/1732] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:20.804955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.807199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.926092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a267-6f07-4c11-a770-45488b6804ac admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.944040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.945455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.945768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.946042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.961258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.963523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.981024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 861/1733] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:21.088716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:21.103174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a6ec3-8465-444f-b4f2-a6666f124c95 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:21.107125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:21.107885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:21.108163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:21.108434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:21.185269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:21.186747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5825f8c-e024-45a3-b212-7ecefb8664a5 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:21.198274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 873/1734] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:22.933697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:22.936339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.081093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7d000-5ae3-499f-840f-7ee56a90e407 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.085911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.086814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.087102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.087459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] PATH_INFO: `/v3/users/fbd43b05f56b43b4a04d3b6caba1b828` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.088644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd43b05f56b43b4a04d3b6caba1b828)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:23.090775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:23.200596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd43b05f56b43b4a04d3b6caba1b828'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.201510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd43b05f56b43b4a04d3b6caba1b828'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.210396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd43b05f56b43b4a04d3b6caba1b828'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.232854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd43b05f56b43b4a04d3b6caba1b828'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.234438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd43b05f56b43b4a04d3b6caba1b828'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.287598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 862/1735] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:22 2022] DELETE /identity/v3/users/fbd43b05f56b43b4a04d3b6caba1b828 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:23.289545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.290086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.290414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.322556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:23.324379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.385592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.484981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:23.486863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.494459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 874/1736] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:23.504465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:23.506337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.509802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656754b-2faf-4128-b971-64b060fda960 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.515129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.516197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.516543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.516820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] PATH_INFO: `/v3/users/a7c5b19ce8704770be8b3790ec6f0901` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.518731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c5b19ce8704770be8b3790ec6f0901)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:23.522352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:23.525921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.638022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c5b19ce8704770be8b3790ec6f0901'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.638668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c5b19ce8704770be8b3790ec6f0901'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.654434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c5b19ce8704770be8b3790ec6f0901'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.674373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57babed4-ada8-4583-96e9-8ec65a93f223 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.685669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.685669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.685669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.685669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.687131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c5b19ce8704770be8b3790ec6f0901'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.687900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc7c2f19-f36f-4edf-9082-d9eccf06cef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c5b19ce8704770be8b3790ec6f0901'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:23.688298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.717187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:23.718842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:23.719279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 863/1737] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:23 2022] DELETE /identity/v3/users/a7c5b19ce8704770be8b3790ec6f0901 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:23.724764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.725290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.725971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.740176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 875/1738] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:23.749140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:23.750711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.878694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 864/1739] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:23.889957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:23.891867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.905525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b671-16ea-4269-b415-7b65127c8710 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.978101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.979417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.979743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.980479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.999029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:24.000903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915884d6-c2b8-43db-99e6-b3eb93186bfb service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:24.024465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 876/1740] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:24.464273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:24.465911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:24.496130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074fb7c-1e39-4bcf-a19a-7e974282e0ef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:24.511847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:24.514795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:24.515089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:24.515372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] PATH_INFO: `/v3/projects/782a2f5efd3f44b0ba01b2a22d3702f8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:24.516677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782a2f5efd3f44b0ba01b2a22d3702f8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:24.518613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:24.644410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782a2f5efd3f44b0ba01b2a22d3702f8', 'request_id': 'req-051ba008-6085-436d-abec-775c3bb02747'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:24.660088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782a2f5efd3f44b0ba01b2a22d3702f8', 'request_id': 'req-051ba008-6085-436d-abec-775c3bb02747'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:24.688355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782a2f5efd3f44b0ba01b2a22d3702f8', 'request_id': 'req-051ba008-6085-436d-abec-775c3bb02747'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:24.743970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] The token cache is being invalidate because project 782a2f5efd3f44b0ba01b2a22d3702f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:24.765504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:24.768889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:24.771580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 865/1741] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:24 2022] DELETE /identity/v3/projects/782a2f5efd3f44b0ba01b2a22d3702f8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:24.777193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f88f2-8455-4b33-b258-8d90847e453c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:24.777801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f88f2-8455-4b33-b258-8d90847e453c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:24.777801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f88f2-8455-4b33-b258-8d90847e453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:24.829625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c30f88f2-8455-4b33-b258-8d90847e453c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:24.831416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c30f88f2-8455-4b33-b258-8d90847e453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:24.846464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:24.847913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:24.857013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:25.024537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba008-6085-436d-abec-775c3bb02747 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.038547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 877/1742] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:25.041415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.041772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.042119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.046611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.048020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.048582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.049082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] PATH_INFO: `/v3/projects/33b3891521c34f90a2422d31582950da` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.050851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b3891521c34f90a2422d31582950da)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.054655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.074757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:25.076819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.091282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 878/1743] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:25.097942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.110838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:25.117984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2406b2-c6e9-4579-9de9-b6fef449992f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.126411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b3891521c34f90a2422d31582950da', 'request_id': 'req-13920472-5b07-402c-9491-06e216c7a288'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.138039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b3891521c34f90a2422d31582950da', 'request_id': 'req-13920472-5b07-402c-9491-06e216c7a288'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.150562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b3891521c34f90a2422d31582950da', 'request_id': 'req-13920472-5b07-402c-9491-06e216c7a288'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.181308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] The token cache is being invalidate because project 33b3891521c34f90a2422d31582950da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:25.182033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.182959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.185376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 866/1744] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:24 2022] DELETE /identity/v3/projects/33b3891521c34f90a2422d31582950da => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:25.189395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.191020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.224262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.224978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.225301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.225697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.226574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:25.226903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.229027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.246335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 879/1745] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:25.251520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.253421 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.269586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff918091-a2be-44f4-a30e-443b772bc2f4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.277050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.278386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.279422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.279844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.280460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.282829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.322764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920472-5b07-402c-9491-06e216c7a288 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.327787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 880/1746] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:25 2022] POST /identity/v3/projects => generated 355 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:25.328721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.423564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:25.439392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549ab86-e53a-48a4-9113-08424e2a0b7d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.449629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.450916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.451468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.452272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.453511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.456009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.457269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.457771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8f977-4b6e-4045-8e82-54e9f15ea9df admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.457882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.460952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] PATH_INFO: `/v3/users/94c7b0566bbc4778aa4f39022b59bb15` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.462865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c7b0566bbc4778aa4f39022b59bb15)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.465873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.494949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 881/1747] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:25 2022] POST /identity/v3/users => generated 278 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:25.501657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.502337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.502337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.538922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:25.544143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.582308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c7b0566bbc4778aa4f39022b59bb15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.586102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c7b0566bbc4778aa4f39022b59bb15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.626379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c7b0566bbc4778aa4f39022b59bb15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.695445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 882/1748] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 26 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:25.696556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.700018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.700155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c7b0566bbc4778aa4f39022b59bb15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.700777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c7b0566bbc4778aa4f39022b59bb15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:25.730698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 867/1749] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:25 2022] DELETE /identity/v3/users/94c7b0566bbc4778aa4f39022b59bb15 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:25.740706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c0b9-98ee-4945-860b-fce5e80c108e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.767348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:25.885814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.886522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.886767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.887044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.887809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.889706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.902020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 883/1750] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:25.917007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.932583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c595-18c1-4217-8dda-349ab580ecad admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.942178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.945439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.946292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.948988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.950100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.957585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bdc6d-dceb-48c7-b357-e15b1ea5f544 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.980060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 868/1751] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:25.984465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.997630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85f66-e7d2-48e2-aad9-bfda54aa8b91 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.008108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.010881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.014065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.014453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] PATH_INFO: `/v3/projects/e9c3329146234c1eb41c48a676bef13c/users/02a69c23a77f4f0395bf8f3b0edf6955/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.049180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c3329146234c1eb41c48a676bef13c, user_id=02a69c23a77f4f0395bf8f3b0edf6955, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.058139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.101250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 884/1752] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:25 2022] PUT /identity/v3/projects/e9c3329146234c1eb41c48a676bef13c/users/02a69c23a77f4f0395bf8f3b0edf6955/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:26.108168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.108457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.110877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.174551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] MFA Rules not processed for user `02a69c23a77f4f0395bf8f3b0edf6955`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:26.175828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:26.334076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 869/1753] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:26.338708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.365731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.367195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:26.418695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.421878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e797-6596-4b27-b3a1-455f9cf90c48 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.428920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.429790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.430075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.430776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.431831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.434079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.445050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60fe84-6644-4525-9e24-36961d3b8664 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.450095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.451099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.451462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.451850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] PATH_INFO: `/v3/projects/2b45f684546c47fb9517e9fb8df7e331` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.453352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b45f684546c47fb9517e9fb8df7e331)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.455526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.469016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 885/1754] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:26.473353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.515967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b45f684546c47fb9517e9fb8df7e331', 'request_id': 'req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:26.523735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b45f684546c47fb9517e9fb8df7e331', 'request_id': 'req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:26.529811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b45f684546c47fb9517e9fb8df7e331', 'request_id': 'req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:26.545445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] The token cache is being invalidate because project 2b45f684546c47fb9517e9fb8df7e331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:26.545735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:26.546454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a4c9d334-6d33-43b6-86be-1f79bc92c8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:26.547924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4286e-d4e3-453e-97c6-1b622f5bc640 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.548114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 870/1755] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:26 2022] DELETE /identity/v3/projects/2b45f684546c47fb9517e9fb8df7e331 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:26.553308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d68ae-e10c-40ae-9324-461899d24243 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.553590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d68ae-e10c-40ae-9324-461899d24243 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.553892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d68ae-e10c-40ae-9324-461899d24243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.572748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.573955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-717d68ae-e10c-40ae-9324-461899d24243 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:26.575280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-717d68ae-e10c-40ae-9324-461899d24243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:26.616301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.616983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.617258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.617526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.618218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.620786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.642975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 886/1756] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:26.646253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 871/1757] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:26.648503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.650106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:26.654318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.654602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.654874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.662273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9277c-a334-491e-9209-01637f7b108e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.666807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.667462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.667777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.668051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.668769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.670381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.673454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:26.674635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:26.680545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 887/1758] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:26.682908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 872/1759] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:26.684989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.686835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.694872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440246-51e7-4409-84ba-d766186c529b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.696968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731d362-7acd-4a52-a6ea-d8ce13e15d17 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.699492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.700394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.700674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.700945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] PATH_INFO: `/v3/projects/d70174963aa0458db6efb7784fb50bca/users/45bef9c5cb084717a680e6a4c917cad6/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.701501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.702157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.702444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.702722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.703461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:26.703806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.705421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.716341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70174963aa0458db6efb7784fb50bca, user_id=45bef9c5cb084717a680e6a4c917cad6, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.717372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 873/1760] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:38:26.718997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.721885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.732294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9a3a-f6f9-4e90-bfe5-fc77424acb34 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.733852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 888/1761] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:26 2022] PUT /identity/v3/projects/d70174963aa0458db6efb7784fb50bca/users/45bef9c5cb084717a680e6a4c917cad6/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:26.737933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.780340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.793128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.794841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.795608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.796109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.797082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.799375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.802297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126d250-1bd9-4b99-a117-2c6c50eb996b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.807817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.808498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.808779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.809182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.809767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.811559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.825568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 889/1762] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:26.829975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.839584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 874/1763] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:26.843236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:26.845604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb9305-fdd6-4da0-b9ec-3986b757d741 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.921495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:26.922396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.922810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.923087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] PATH_INFO: `/v3/projects/d70174963aa0458db6efb7784fb50bca/users/45bef9c5cb084717a680e6a4c917cad6/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.925399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70174963aa0458db6efb7784fb50bca, user_id=45bef9c5cb084717a680e6a4c917cad6, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:26.928218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673704-9587-4123-a850-ec6e2edec275 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:26.936511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842e537-2222-4769-b111-7b30c8a8d339 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:26.953887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 890/1764] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:26 2022] PUT /identity/v3/projects/d70174963aa0458db6efb7784fb50bca/users/45bef9c5cb084717a680e6a4c917cad6/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:26.956765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:26.957209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:26.957629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:26.966529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.999136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] MFA Rules not processed for user `45bef9c5cb084717a680e6a4c917cad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:27.000384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.034036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.034742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.035001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.035281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.035995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.038316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.062699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 875/1765] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:27.063758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.073318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd32e-cf75-489c-a7cc-69fbc22ca02b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.078038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.078747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.079167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.079566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.080345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.082038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 891/1766] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:27.082183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.092741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 876/1767] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:27.093803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.095253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.096336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.105827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542138e8-b94e-4506-838d-6c738d2c2689 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.110523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.111187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.111475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.111784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.112514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.114105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.127648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 877/1768] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:27.128615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.139061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bfb42-46b8-48a8-81b7-b141b47cf9f2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.143647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.144524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.144810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.145079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] PATH_INFO: `/v3/projects/979a353bced54ccca0f9628cb9f06e53/users/e50795cd6bae4098b28c0f387104760f/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.157747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf558-99ee-4c7c-8b25-958c378f9636 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.160270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979a353bced54ccca0f9628cb9f06e53, user_id=e50795cd6bae4098b28c0f387104760f, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.162080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.162729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.162961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bcd06-ad5c-452f-b3f8-d4a6272bac90 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.163094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.163261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.174080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.175883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.178869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 878/1769] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:27 2022] PUT /identity/v3/projects/979a353bced54ccca0f9628cb9f06e53/users/e50795cd6bae4098b28c0f387104760f/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:27.186350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 892/1770] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:27.190473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.190753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.191104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.220689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] MFA Rules not processed for user `e50795cd6bae4098b28c0f387104760f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:27.222464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.241124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:27.269822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.272566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.285497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738836ee-a331-42e6-84b7-b6510ecc4518 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.341690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 879/1771] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:27.347454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.359129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.360130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.360649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.361084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.367167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.431638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:27.438799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cb664-7211-41e1-a1c3-ae31ecb052dd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.444384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.445069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.445351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.445620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.446327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.448359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.449062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.450524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.459517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 893/1772] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:27.488488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 880/1773] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:27 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:27.492676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.506123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907a97f-6e86-4b19-80b7-923a951ef275 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.583571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.584688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.584970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.585238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.585986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.588189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.630026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 894/1774] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:27 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:27.634618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.651258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949222-84b8-40ca-9695-332d810fbb9f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.657231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.658114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.658379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.658652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.659390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.661101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.673282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 881/1775] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:27.677598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.691582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030ae2-93f2-437c-8347-f0e140cd10a8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.695078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.696043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.696324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.696596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] PATH_INFO: `/v3/projects/d2f908ca2db24914b1db1545e3e92545/users/4682b5b47c5948408df4142c44b2f962/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.713733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f908ca2db24914b1db1545e3e92545, user_id=4682b5b47c5948408df4142c44b2f962, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.716563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.735891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 895/1776] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:27 2022] PUT /identity/v3/projects/d2f908ca2db24914b1db1545e3e92545/users/4682b5b47c5948408df4142c44b2f962/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:27.740080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.750718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c294-d4c7-4720-9330-61dce9954c23 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.816504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.817181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.817474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.817856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.818585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.820420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985caa10-c546-4059-9a65-e75c7a5cddf6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.832726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 882/1777] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:27.836906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.847864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161763-8b20-4705-929d-686d861372d3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.852768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.853673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.853952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.854222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] PATH_INFO: `/v3/projects/d2f908ca2db24914b1db1545e3e92545/users/4682b5b47c5948408df4142c44b2f962/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.856236 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f908ca2db24914b1db1545e3e92545, user_id=4682b5b47c5948408df4142c44b2f962, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.858915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.869653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 896/1778] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:27 2022] PUT /identity/v3/projects/d2f908ca2db24914b1db1545e3e92545/users/4682b5b47c5948408df4142c44b2f962/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:27.881269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.881570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.881852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.911592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] MFA Rules not processed for user `4682b5b47c5948408df4142c44b2f962`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:27.912859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.931897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:27.994297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 883/1779] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:28.005002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:28.071516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87043-9f24-4013-b88c-a4414c9344ac admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:28.076509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:28.076509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.076784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.077051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.087154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:28.088855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:28.099335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 897/1780] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:28.204377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:28.214078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09761-517f-4125-93f9-e704f34ad9d1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:28.217790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:28.218452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.218736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.219012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.277072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:28.278517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a1cfd-787d-4517-a045-0773b594997b service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:28.290064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 884/1781] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:31.109536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:31.111626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.165859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:31.193127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56043-76bd-4b27-bb68-09126b362e63 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:31.198474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:31.199216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.199560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.199897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.201766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.212067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:31.213533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4376f9-2236-41fd-baf0-b5e514d27a71 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:31.222631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 898/1782] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:32.221836 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:32.222358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:32.222433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:32.226588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 885/1783] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:38:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:32.238592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:32.239140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:32.239140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:32.274026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:32.275247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:32.398981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 899/1784] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:32.411119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:32.413166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:32.433774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8638-8ea8-4933-8111-8d4e7b5f8f9d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:32.442477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:32.443153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:32.443528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:32.443799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:32.458025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:32.460183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76220d7-c74f-49ca-aba9-5e53083e550a service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:32.476076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 886/1785] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:34.863130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:34.865710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:34.939820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f627-348c-4cf9-8bcc-394a0501031b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:34.940417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f627-348c-4cf9-8bcc-394a0501031b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:34.940716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f627-348c-4cf9-8bcc-394a0501031b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:34.945302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 887/1786] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:38:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:34.960466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:34.961731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:34.962540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.003117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:35.005500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:35.032065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 888/1787] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:35.043812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ee83-7cd1-4a15-ab0f-e0f76ef86c78 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:35.046560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:35.049724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:35.057462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:35.058197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.058470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.058736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] PATH_INFO: `/v3/users/4bca36b1001c409fa0c9086c10bce9b4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.063234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bca36b1001c409fa0c9086c10bce9b4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:35.065384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:35.078982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5601aac-7549-4aea-bcb4-610da0915d58 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:35.096213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:35.097181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.098155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.098435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.126866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:35.130551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:35.163285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 889/1788] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:35.234712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bca36b1001c409fa0c9086c10bce9b4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.236059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bca36b1001c409fa0c9086c10bce9b4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.238217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bca36b1001c409fa0c9086c10bce9b4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.253194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:35.255179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bca36b1001c409fa0c9086c10bce9b4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.267253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-98cf4d13-886f-4b34-8671-b940e346b3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bca36b1001c409fa0c9086c10bce9b4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.272028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ffb4-14de-49cf-aafd-083fdd03a7ab service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:35.275906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:35.286686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:35.293557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.295390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.296009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] PATH_INFO: `/v3/users/e50795cd6bae4098b28c0f387104760f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.299580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 900/1789] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:34 2022] DELETE /identity/v3/users/4bca36b1001c409fa0c9086c10bce9b4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:35.304512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50795cd6bae4098b28c0f387104760f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:35.305987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.306453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.306743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:35.307131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.349999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:35.350897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:35.424359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50795cd6bae4098b28c0f387104760f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.426368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50795cd6bae4098b28c0f387104760f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.472355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50795cd6bae4098b28c0f387104760f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.508868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:35.513787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50795cd6bae4098b28c0f387104760f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.517393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8306f66-cdea-4f0e-965c-df36d3a58138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50795cd6bae4098b28c0f387104760f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:35.535436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 901/1790] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:35.547067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:35.554406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 890/1791] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:35 2022] DELETE /identity/v3/users/e50795cd6bae4098b28c0f387104760f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:35.556035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:35.558225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.559766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.560731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.627771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:35.631099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:35.722149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dbc23-2d1a-4d83-927d-b0e6b01e131b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:35.767409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 891/1792] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:35.778183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:35.797816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:35.798484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.798771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.799039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.809526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:35.810988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:35.821600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 902/1793] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:35.839171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3e3e-c3d8-4967-a6bd-8c86610f5c21 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:35.842965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:35.843814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:35.844213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:35.844726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:35.854627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:35.856117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe60a8-2b8b-47c8-9f1a-a319e36c0fad service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:35.867256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 892/1794] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:36.158033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.159717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.174789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4706-da1d-4f0f-9902-d27bd2781997 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.181271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.182380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.182840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.183119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] PATH_INFO: `/v3/projects/6b91060d27d543f4b24dd0b6c2300722` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.184910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b91060d27d543f4b24dd0b6c2300722)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.186953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.249086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b91060d27d543f4b24dd0b6c2300722', 'request_id': 'req-1af2006e-1b55-4f98-9985-7e87b2f23428'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.250435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:36.258250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b91060d27d543f4b24dd0b6c2300722', 'request_id': 'req-1af2006e-1b55-4f98-9985-7e87b2f23428'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.267848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b91060d27d543f4b24dd0b6c2300722', 'request_id': 'req-1af2006e-1b55-4f98-9985-7e87b2f23428'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.284690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] The token cache is being invalidate because project 6b91060d27d543f4b24dd0b6c2300722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:36.285251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.285893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.287830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 903/1795] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:36 2022] DELETE /identity/v3/projects/6b91060d27d543f4b24dd0b6c2300722 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:36.292880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0201-5942-42c9-b0f8-7d5a7d92f8c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.293882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0201-5942-42c9-b0f8-7d5a7d92f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.294318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0201-5942-42c9-b0f8-7d5a7d92f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.316634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-01de0201-5942-42c9-b0f8-7d5a7d92f8c6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:36.318050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-01de0201-5942-42c9-b0f8-7d5a7d92f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.379573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.381128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.404033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 893/1796] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:36.405832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.406126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.406455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.432191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:36.433435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.448958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 894/1797] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:36.453425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.463914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59ac1c-c187-4e32-92d6-81229c42a1c4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.473283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2006e-1b55-4f98-9985-7e87b2f23428 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.473450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.473450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.473450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.473758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.474332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:36.474891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.476399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.491911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.493112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.493485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.494277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] PATH_INFO: `/v3/projects/979a353bced54ccca0f9628cb9f06e53` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.496310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=979a353bced54ccca0f9628cb9f06e53)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.500491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.554393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 895/1798] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:38:36.557163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.577968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834d9f-6276-425a-9392-7d535143ea44 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.578216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979a353bced54ccca0f9628cb9f06e53', 'request_id': 'req-0799f04c-0f96-4986-9085-c663c3a198cb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.587242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979a353bced54ccca0f9628cb9f06e53', 'request_id': 'req-0799f04c-0f96-4986-9085-c663c3a198cb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.598331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:36.601505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979a353bced54ccca0f9628cb9f06e53', 'request_id': 'req-0799f04c-0f96-4986-9085-c663c3a198cb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.627815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] The token cache is being invalidate because project 979a353bced54ccca0f9628cb9f06e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:36.628574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.629504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:36.632230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 904/1799] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:36 2022] DELETE /identity/v3/projects/979a353bced54ccca0f9628cb9f06e53 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:36.638146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.639717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.669908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.670870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.671160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.671489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.672333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.674629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.731527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 896/1800] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:36.735794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.737533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.807129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f04c-0f96-4986-9085-c663c3a198cb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.824143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:36.899483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8712e7-fec8-400e-ac99-01a91b8fa726 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.907666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.909775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.910123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.910408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] PATH_INFO: `/v3/users/4682b5b47c5948408df4142c44b2f962` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.914791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.915510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.915847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4682b5b47c5948408df4142c44b2f962)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.915960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.916299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.916989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.922002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.922888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.968431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 897/1801] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:36.972703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.993279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87da5b-d859-4c11-8396-1f714dd7bb44 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.007129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.008259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.008637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.009658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.010586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.012418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.028524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4682b5b47c5948408df4142c44b2f962'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:37.029371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4682b5b47c5948408df4142c44b2f962'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:37.031268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4682b5b47c5948408df4142c44b2f962'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:37.033418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 898/1802] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:37.038939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.041336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:37.060042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fce1-1401-4904-b631-5e22951683d5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.063169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4682b5b47c5948408df4142c44b2f962'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:37.068399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.069932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.070332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.071205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.072989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.073294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f977b26a-ecbe-4611-8691-87ebba14e5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4682b5b47c5948408df4142c44b2f962'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:37.075052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.103761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 899/1803] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:37.106718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 905/1804] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:36 2022] DELETE /identity/v3/users/4682b5b47c5948408df4142c44b2f962 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:37.110654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.124904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51d1a-c5e5-43d9-afeb-0f77058037a1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.236173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.237076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.237355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.237627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] PATH_INFO: `/v3/projects/436b99138ef64323b6ba642624206354/users/5dcaf586ec5d466b8d515d31d796945f/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.272145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:37.279281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b99138ef64323b6ba642624206354, user_id=5dcaf586ec5d466b8d515d31d796945f, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.281812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.304308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 900/1805] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:37 2022] PUT /identity/v3/projects/436b99138ef64323b6ba642624206354/users/5dcaf586ec5d466b8d515d31d796945f/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:37.316552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.317442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.317925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.361637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] MFA Rules not processed for user `5dcaf586ec5d466b8d515d31d796945f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:37.363201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:37.438758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 906/1806] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:37.444144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.514819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64cf0-d6c2-4be0-a49b-eb851d5a61d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.519469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.520166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.520446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.520715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.521421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.523875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.554419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 901/1807] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:37 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:37.558974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.573309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb992-c5ad-46c1-95f6-8593d0de1d8c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.602714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:37.670943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.671634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.671917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.672242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.685147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.696738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.716238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 907/1808] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:37 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:37.719973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.735035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb49e-0ab5-4662-bdf9-43cc53c7f6a1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.741246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.742622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.743251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.743843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.745038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.747643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.764270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 902/1809] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:37.768748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.807462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5d6-6270-4471-aaba-9c08e402ae82 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.836420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.837357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.837634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.837927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] PATH_INFO: `/v3/projects/44011b865b1341d3a4d07cf5b1a320a7/users/fd67a7a311864a76890f8efcb607fbf9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.873183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44011b865b1341d3a4d07cf5b1a320a7, user_id=fd67a7a311864a76890f8efcb607fbf9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.877256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.901175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 908/1810] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:37 2022] PUT /identity/v3/projects/44011b865b1341d3a4d07cf5b1a320a7/users/fd67a7a311864a76890f8efcb607fbf9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:37.904985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.921993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d07a-f09e-4cc5-b3a0-297f601c17af admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.994519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.998320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.040317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.041010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.041295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.041624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.042365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.044089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.060102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 903/1811] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:38.060102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.060946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.076100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320aea7-fc64-415a-8443-3a985a1c7ce3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.080993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.081871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.082152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.082421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] PATH_INFO: `/v3/projects/d2f908ca2db24914b1db1545e3e92545` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.083636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f908ca2db24914b1db1545e3e92545)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.087490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.116618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b74a-b290-45e6-9f9c-e47b7ad22bd6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.122573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.123634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.123990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.124293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] PATH_INFO: `/v3/users/55fc573e003542929754b30458301e5b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.125654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fc573e003542929754b30458301e5b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.127700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.151590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f908ca2db24914b1db1545e3e92545', 'request_id': 'req-3f3398cc-225d-4f46-a963-49a1cd3975fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.170456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f908ca2db24914b1db1545e3e92545', 'request_id': 'req-3f3398cc-225d-4f46-a963-49a1cd3975fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.171999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.177459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f908ca2db24914b1db1545e3e92545', 'request_id': 'req-3f3398cc-225d-4f46-a963-49a1cd3975fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.199889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] The token cache is being invalidate because project d2f908ca2db24914b1db1545e3e92545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:38.200180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.201295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.203386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 904/1812] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:38 2022] DELETE /identity/v3/projects/d2f908ca2db24914b1db1545e3e92545 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:38.208063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.209586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fc573e003542929754b30458301e5b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.209893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.210537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fc573e003542929754b30458301e5b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.211251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fc573e003542929754b30458301e5b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.227972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fc573e003542929754b30458301e5b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.236120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4918a489-27da-4f1e-95e2-4ba003ce3338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fc573e003542929754b30458301e5b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:38.254901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 909/1813] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:37 2022] DELETE /identity/v3/users/55fc573e003542929754b30458301e5b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:38.256963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7394-7e98-472e-8adc-f8cca8ff6906 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.257249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7394-7e98-472e-8adc-f8cca8ff6906 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.257524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7394-7e98-472e-8adc-f8cca8ff6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.282457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ce6c7394-7e98-472e-8adc-f8cca8ff6906 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:38.283630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ce6c7394-7e98-472e-8adc-f8cca8ff6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.289436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.306466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3398cc-225d-4f46-a963-49a1cd3975fa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.402207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.403692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.403926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.404198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] PATH_INFO: `/v3/projects/44011b865b1341d3a4d07cf5b1a320a7/users/fd67a7a311864a76890f8efcb607fbf9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.407750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44011b865b1341d3a4d07cf5b1a320a7, user_id=fd67a7a311864a76890f8efcb607fbf9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.410459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61131-a4db-4a35-bd6a-8dae0ce5dc19 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.429610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 910/1814] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:38.436820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78056-7e69-4e21-a1ba-5c2955e73fe7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.436820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78056-7e69-4e21-a1ba-5c2955e73fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.436820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78056-7e69-4e21-a1ba-5c2955e73fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.443575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 905/1815] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:38 2022] PUT /identity/v3/projects/44011b865b1341d3a4d07cf5b1a320a7/users/fd67a7a311864a76890f8efcb607fbf9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:38.446003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.446463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.446747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.486392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f4f78056-7e69-4e21-a1ba-5c2955e73fe7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:38.492016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4f78056-7e69-4e21-a1ba-5c2955e73fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.494090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:38.495952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.680745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 911/1816] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:38.683026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.684540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.684955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.689600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 906/1817] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:38.694433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.715450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ac25d-66c1-4f1b-bfed-a03bb3ebf641 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.721094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.722201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.722201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.722448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.723440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:38.723803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.725875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.736534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] MFA Rules not processed for user `fd67a7a311864a76890f8efcb607fbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:38.737761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.752754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 907/1818] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:38.753545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.759885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.790616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.879734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 912/1819] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:38.879734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.881499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defd49-5d86-4e40-abf8-8a3a58974d58 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.886469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.888627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.888989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.889341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.896365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8630-f7d9-468e-979b-f848d73d5530 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.905068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.906531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.907159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.907401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.907772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.908109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.909166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.911786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.931741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 908/1820] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:38.933085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.935078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.953372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 913/1821] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:38.957598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.991657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:39.067112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553867-a091-466b-b2e7-a0c79fc0bb86 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.122569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e3f9-a710-4022-bc2c-a297d2032a32 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.136012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.136702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.136984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.137253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.137948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.141239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.193652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 914/1822] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:39.198984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.212337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.213284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.213565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.213839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.220213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f439-e5e5-46d0-81d5-befbfe932e3c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.238001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.238990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.239301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.241267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.243308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.249476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.269260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 915/1823] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:39.274695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.303234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcf03-be26-4c66-a8c1-a59d179f5454 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.317535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.318233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.318669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.319054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.319992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.324385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.356384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 916/1824] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:39.359835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.360882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.361486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.374781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 909/1825] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:39.375470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71c979-2cef-4b49-b069-deeefc8431d5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.398602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.399783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.400072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.400392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] PATH_INFO: `/v3/projects/9bacfa32e2044f12b131a0d0235a75ce/users/8bbfd1c82157441cb6092da65bcdb9d6/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.412443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.414227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:39.436483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba194a-22b4-422e-afb2-9cb52799012f service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.441496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bacfa32e2044f12b131a0d0235a75ce, user_id=8bbfd1c82157441cb6092da65bcdb9d6, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.445683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9c52-71e0-4e4b-83c2-3d0dc40ebaa9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.461064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.472259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.472667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.473022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] PATH_INFO: `/v3/projects/09c3cfa4825a437b924f3d94ab07cd02` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.474502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c3cfa4825a437b924f3d94ab07cd02)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.476627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.483874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 917/1826] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:39 2022] PUT /identity/v3/projects/9bacfa32e2044f12b131a0d0235a75ce/users/8bbfd1c82157441cb6092da65bcdb9d6/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:39.501098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.501509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.501846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.516394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:39.574741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] MFA Rules not processed for user `8bbfd1c82157441cb6092da65bcdb9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:39.576681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:39.587256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c3cfa4825a437b924f3d94ab07cd02', 'request_id': 'req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.599898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c3cfa4825a437b924f3d94ab07cd02', 'request_id': 'req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.625360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c3cfa4825a437b924f3d94ab07cd02', 'request_id': 'req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.652166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] The token cache is being invalidate because project 09c3cfa4825a437b924f3d94ab07cd02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:39.652535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.653372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.660060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 910/1827] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:39 2022] DELETE /identity/v3/projects/09c3cfa4825a437b924f3d94ab07cd02 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:39.660877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.664524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:39.742939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 918/1828] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:39.747141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:39.748810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:39.843488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad977-aa4b-4279-8cd4-a5f44bceffe1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.866608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.867529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.867833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.868103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] PATH_INFO: `/v3/users/b25bb93eb6b9404f98c7e4fcd0c8999d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.870346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25bb93eb6b9404f98c7e4fcd0c8999d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.887496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.911675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:39.956829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fb93-93ad-4fa4-9be8-108edfe8a864 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:39.970599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:39.973946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:39.974529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:39.975154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:39.977530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:39.980310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:39.993563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25bb93eb6b9404f98c7e4fcd0c8999d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:39.996136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25bb93eb6b9404f98c7e4fcd0c8999d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.012858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25bb93eb6b9404f98c7e4fcd0c8999d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.051775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25bb93eb6b9404f98c7e4fcd0c8999d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.052981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25bb93eb6b9404f98c7e4fcd0c8999d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.059728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 919/1829] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:39 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:40.061528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.066423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.079280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 911/1830] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:39 2022] DELETE /identity/v3/users/b25bb93eb6b9404f98c7e4fcd0c8999d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:40.187093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791faf-5efc-49a7-82cb-cbbd39077b31 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.366779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.368485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.369111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.369696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.370620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.376251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.415527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 920/1831] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:40 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:40.416969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.429695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec916-eaea-4501-a3dd-d86150b20e8e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.447060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.448121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.448870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.449392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.455955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.459401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.478139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 912/1832] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:40.482207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.503049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58f3c-4a86-44ad-a911-3fd101d00e14 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.516157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.517534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.517981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.518269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] PATH_INFO: `/v3/projects/35e339bbee6e40108ec51035d6d78fc3/users/700e1f57e9974d8ea708323af8e3620e/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.574593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e339bbee6e40108ec51035d6d78fc3, user_id=700e1f57e9974d8ea708323af8e3620e, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.578028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.618955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 921/1833] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:40 2022] PUT /identity/v3/projects/35e339bbee6e40108ec51035d6d78fc3/users/700e1f57e9974d8ea708323af8e3620e/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:40.624071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.645743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f18c76-584f-47f7-86be-03991c8e7a25 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.666887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.668541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:40.669151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.761136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:40.796952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.797633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.797912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.798183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.798921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.800259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3cee9-ee7e-4f24-8a53-b9c12378b803 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.800564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.807154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.808358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.808795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.809223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] PATH_INFO: `/v3/projects/73601a40f54b4d30ab64a73302abde83` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.811080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73601a40f54b4d30ab64a73302abde83)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.814431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.815216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 913/1834] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:40.820587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.833323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177290-1c83-4a39-b1d1-791d2d245963 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.838929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.839949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.840256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.840547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] PATH_INFO: `/v3/projects/35e339bbee6e40108ec51035d6d78fc3/users/700e1f57e9974d8ea708323af8e3620e/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.843623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e339bbee6e40108ec51035d6d78fc3, user_id=700e1f57e9974d8ea708323af8e3620e, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.849161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110e4b-f6f9-4080-a61e-af8b2f06502c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.864917 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 914/1835] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:40 2022] PUT /identity/v3/projects/35e339bbee6e40108ec51035d6d78fc3/users/700e1f57e9974d8ea708323af8e3620e/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:40.876660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.876994 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.877631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.881042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73601a40f54b4d30ab64a73302abde83', 'request_id': 'req-030f769c-93e9-4e94-b6fa-014473a4cb2f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.889300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73601a40f54b4d30ab64a73302abde83', 'request_id': 'req-030f769c-93e9-4e94-b6fa-014473a4cb2f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.898267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73601a40f54b4d30ab64a73302abde83', 'request_id': 'req-030f769c-93e9-4e94-b6fa-014473a4cb2f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.912568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] MFA Rules not processed for user `700e1f57e9974d8ea708323af8e3620e`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:40.913925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.916893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] The token cache is being invalidate because project 73601a40f54b4d30ab64a73302abde83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:40.917188 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.917938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-030f769c-93e9-4e94-b6fa-014473a4cb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:40.919945 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 922/1836] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:40 2022] DELETE /identity/v3/projects/73601a40f54b4d30ab64a73302abde83 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:40.925014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cfea-df5a-4152-9b9f-b7f6fefd8948 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.925480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cfea-df5a-4152-9b9f-b7f6fefd8948 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.925808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cfea-df5a-4152-9b9f-b7f6fefd8948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.950047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f568cfea-df5a-4152-9b9f-b7f6fefd8948 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:40.951264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f568cfea-df5a-4152-9b9f-b7f6fefd8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.007911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 915/1837] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:41.020435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.023388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.056901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 923/1838] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:41.068832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.069667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.070146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.098229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875dac-737b-40ce-a91a-fc7c02ab3b3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.102265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:41.102425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.103321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.103751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.104222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.105381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.117110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.118713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.125377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 924/1839] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:41.130458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.133105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 916/1840] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:41.142540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef638a-9b0d-4711-8460-3f43cdadff21 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.149934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.151476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.151932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.152498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.153361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:41.153905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.156376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.176652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 925/1841] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:41.181553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.201629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc3f-5bc4-4ed5-8ef9-4f439a0fa392 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.212211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.213023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.213375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.213655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.214408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.216912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.251349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:41.269981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.271721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 917/1842] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:41.285974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372089c-ef98-4829-8783-d8cf3fa27eca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.394512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:41.408735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.410594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.410928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.411396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.412410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.416619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.456789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 926/1843] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:41.461072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.483357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890eee-e367-4a3f-923f-f9c693cad510 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.488128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.488813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.489678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.489678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.490099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.491910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.503050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 918/1844] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:41.508107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.520286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74805d6-7bdf-4f72-b5f2-3bf523a0398c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.526610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.530876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.530876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.530876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.530876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.530876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3741-2d74-42ec-b272-0d5de6dbd76f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.547451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 927/1845] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:41.552651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.563339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19831ba-5dd9-44ae-ba3c-40d26389149c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.568758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.569931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.570183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.570536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] PATH_INFO: `/v3/projects/f8a7391514f64de7beba2e1ccadeb8ba/users/197344f04a0f40e5b7e4a15cbb8ad624/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.589060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a7391514f64de7beba2e1ccadeb8ba, user_id=197344f04a0f40e5b7e4a15cbb8ad624, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.592142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18168-11f0-4384-8179-3a78ca5bf7bc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.613597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 919/1846] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:41 2022] PUT /identity/v3/projects/f8a7391514f64de7beba2e1ccadeb8ba/users/197344f04a0f40e5b7e4a15cbb8ad624/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:41.624119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.624437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.625082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.652520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febae759-21e6-4613-b1f1-1e49e46a04b6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.652920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febae759-21e6-4613-b1f1-1e49e46a04b6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.653305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febae759-21e6-4613-b1f1-1e49e46a04b6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.655200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 920/1847] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:41.666229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] MFA Rules not processed for user `197344f04a0f40e5b7e4a15cbb8ad624`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:41.666493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.666766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.667955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.668193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.692566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:41.693907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.790673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 928/1848] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:41.797473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.831327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 921/1849] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:41.848947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.851005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.870739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfade0-1a67-49c9-87f0-6adb27636d17 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.877776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.878303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.878590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.878868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.890569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.892215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.905093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 922/1850] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:41.950010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c1a5b-3513-47fb-972a-2745e8e00db1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.954572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.955788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.956428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.957215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.958113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.961396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.014781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 929/1851] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/projects => generated 393 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:42.019143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.035446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5063-aae0-4c3b-b7d6-462534dfd3a3 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.156284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.157151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.157520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.158048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.158851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.162455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.193641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.195729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 923/1852] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:42 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:42.198322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.201985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.222904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e928f-9333-446f-ba65-f0cb1e4145de admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.234232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041a78-6baa-48d8-8276-7cd6c42a7650 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.238898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.241096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.241380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.241658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] PATH_INFO: `/v3/users/5dcaf586ec5d466b8d515d31d796945f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.244432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.245357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.245538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcaf586ec5d466b8d515d31d796945f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.245830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.246194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.247035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.248898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.250283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.279296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 924/1853] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:42.283611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.302667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088756-6f31-48da-8abb-20c87d3d9dc7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.331779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.333494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.333653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.334112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] PATH_INFO: `/v3/projects/3995f4f3b49f46bda939d19ec9021b6c/users/c78605d7382a47c39483783ef5d4b005/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.385661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.387449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3995f4f3b49f46bda939d19ec9021b6c, user_id=c78605d7382a47c39483783ef5d4b005, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.390957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcaf586ec5d466b8d515d31d796945f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.393572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcaf586ec5d466b8d515d31d796945f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.400310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.412320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcaf586ec5d466b8d515d31d796945f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.433866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.434907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcaf586ec5d466b8d515d31d796945f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.444793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcaf586ec5d466b8d515d31d796945f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.455134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 925/1854] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:42 2022] PUT /identity/v3/projects/3995f4f3b49f46bda939d19ec9021b6c/users/c78605d7382a47c39483783ef5d4b005/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:42.456032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.457802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.466288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 930/1855] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:42 2022] DELETE /identity/v3/users/5dcaf586ec5d466b8d515d31d796945f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:42.467575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.470100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.554780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98fb3-2730-4755-87a8-d7d1f8dae5b6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.568062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.569213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.570022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.570180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.570817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.572508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2bd3b-066d-458e-b020-503e3f6fe73d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.593282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6fdd-1024-4909-b70a-74cbf32b263b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.598118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 931/1856] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:42.598118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.598118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.598516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.607125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.608083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.608366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.608642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] PATH_INFO: `/v3/users/8bbfd1c82157441cb6092da65bcdb9d6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.610806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbfd1c82157441cb6092da65bcdb9d6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.612762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.626310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:42.629384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.643584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 932/1857] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:42.644981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.659782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4bd5b-dcc0-4f09-ad5f-6f56f85cbe28 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.667967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.668883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.669263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.669417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] PATH_INFO: `/v3/projects/3995f4f3b49f46bda939d19ec9021b6c/users/c78605d7382a47c39483783ef5d4b005/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.672716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3995f4f3b49f46bda939d19ec9021b6c, user_id=c78605d7382a47c39483783ef5d4b005, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.677390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.686620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbfd1c82157441cb6092da65bcdb9d6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.687406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbfd1c82157441cb6092da65bcdb9d6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.699418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbfd1c82157441cb6092da65bcdb9d6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.710058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 933/1858] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:42 2022] PUT /identity/v3/projects/3995f4f3b49f46bda939d19ec9021b6c/users/c78605d7382a47c39483783ef5d4b005/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:42.710058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.713798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.716479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbfd1c82157441cb6092da65bcdb9d6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.717249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9f89ce1-e675-4157-a8f9-eacee1195792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbfd1c82157441cb6092da65bcdb9d6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:42.737650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 926/1859] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:42 2022] DELETE /identity/v3/users/8bbfd1c82157441cb6092da65bcdb9d6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:42.738733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53991b9-0aef-4035-9224-5f0fa9c72091 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.739238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53991b9-0aef-4035-9224-5f0fa9c72091 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.739343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53991b9-0aef-4035-9224-5f0fa9c72091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.782242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d53991b9-0aef-4035-9224-5f0fa9c72091 None None] MFA Rules not processed for user `c78605d7382a47c39483783ef5d4b005`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:42.784054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d53991b9-0aef-4035-9224-5f0fa9c72091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.827519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb97f-5fae-4831-abc4-35b7da2052b8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:42.864031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 927/1860] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:42.865803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.866242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.866522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.874933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.885999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:42.886903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:42.887504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:42.887669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:42.890163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.890277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:42.893161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.898294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.971099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 928/1861] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:42.972153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.973513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:42.978561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:42.980101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:42.992104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 934/1862] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:42.993059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:42.994473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.004969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedb4a8-7819-4fe1-a044-bf88e5d537cb service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.008901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.009560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.009841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.010114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.021137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.023214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.033865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 935/1863] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:43.058422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39958a-d267-4e39-9270-339bc66695f9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.064381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.065564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.065855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.066157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.080194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.082479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.099079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 929/1864] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:43.173719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.185583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d72fc4-7ad5-486b-a82f-b017274fc931 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.193034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.193865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.194235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.195436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.199688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.297773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.299425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.313052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 936/1865] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:43.400829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.403045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.437440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ebb1-3bd6-4a55-9f80-0e23f8f5031c service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.452837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.453851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.454222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.454565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] PATH_INFO: `/v3/projects/9bacfa32e2044f12b131a0d0235a75ce` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.457386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bacfa32e2044f12b131a0d0235a75ce)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.459820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.570028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bacfa32e2044f12b131a0d0235a75ce', 'request_id': 'req-f2bf25f0-9363-4553-849a-ccd542731fc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.580082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bacfa32e2044f12b131a0d0235a75ce', 'request_id': 'req-f2bf25f0-9363-4553-849a-ccd542731fc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.587662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bacfa32e2044f12b131a0d0235a75ce', 'request_id': 'req-f2bf25f0-9363-4553-849a-ccd542731fc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.619754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] The token cache is being invalidate because project 9bacfa32e2044f12b131a0d0235a75ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:43.621152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.622621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.625984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 930/1866] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:43 2022] DELETE /identity/v3/projects/9bacfa32e2044f12b131a0d0235a75ce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:43.634092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.667439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd5c3-69e0-4485-88e3-2501ecb56f5c service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.792575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.793708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.793980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.794252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] PATH_INFO: `/v3/users/700e1f57e9974d8ea708323af8e3620e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.795461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700e1f57e9974d8ea708323af8e3620e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.797450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.858396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:43.879783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700e1f57e9974d8ea708323af8e3620e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.880540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700e1f57e9974d8ea708323af8e3620e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.881940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700e1f57e9974d8ea708323af8e3620e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.898021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700e1f57e9974d8ea708323af8e3620e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.906447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700e1f57e9974d8ea708323af8e3620e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:43.928689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 937/1867] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:43 2022] DELETE /identity/v3/users/700e1f57e9974d8ea708323af8e3620e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:43.954910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.956575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.971900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf25f0-9363-4553-849a-ccd542731fc7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.020661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:44.055787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.056709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.056991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.057269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] PATH_INFO: `/v3/projects/436b99138ef64323b6ba642624206354` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.058475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=436b99138ef64323b6ba642624206354)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.060504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.111784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436b99138ef64323b6ba642624206354', 'request_id': 'req-9d08ed70-8b90-42d3-a803-1090b53d02ec'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.118684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436b99138ef64323b6ba642624206354', 'request_id': 'req-9d08ed70-8b90-42d3-a803-1090b53d02ec'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.124733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436b99138ef64323b6ba642624206354', 'request_id': 'req-9d08ed70-8b90-42d3-a803-1090b53d02ec'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.140183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] The token cache is being invalidate because project 436b99138ef64323b6ba642624206354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:44.140598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.141531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.145863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 931/1868] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:43 2022] DELETE /identity/v3/projects/436b99138ef64323b6ba642624206354 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:44.148134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.149346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.164809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c98f-cd21-47b1-8c63-ac5cf10f7779 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.234526 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.235817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.236101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.236376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] PATH_INFO: `/v3/users/fd67a7a311864a76890f8efcb607fbf9` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.237653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd67a7a311864a76890f8efcb607fbf9)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.240193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.244165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.245659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.274303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ed70-8b90-42d3-a803-1090b53d02ec admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.288419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.290334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.290824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.291098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] PATH_INFO: `/v3/projects/35e339bbee6e40108ec51035d6d78fc3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.294211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e339bbee6e40108ec51035d6d78fc3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.296581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.316095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd67a7a311864a76890f8efcb607fbf9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.317103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd67a7a311864a76890f8efcb607fbf9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.317716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd67a7a311864a76890f8efcb607fbf9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.334303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd67a7a311864a76890f8efcb607fbf9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.342871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-43504c4d-8a42-4780-94aa-2a1f0d25b282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd67a7a311864a76890f8efcb607fbf9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.357075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e339bbee6e40108ec51035d6d78fc3', 'request_id': 'req-778f85c7-4c24-4bb6-b628-ec8648f68894'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.362752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 938/1869] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:44 2022] DELETE /identity/v3/users/fd67a7a311864a76890f8efcb607fbf9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:44.364913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e339bbee6e40108ec51035d6d78fc3', 'request_id': 'req-778f85c7-4c24-4bb6-b628-ec8648f68894'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.372887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e339bbee6e40108ec51035d6d78fc3', 'request_id': 'req-778f85c7-4c24-4bb6-b628-ec8648f68894'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.388678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] The token cache is being invalidate because project 35e339bbee6e40108ec51035d6d78fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:44.389189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.389869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-778f85c7-4c24-4bb6-b628-ec8648f68894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.391490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 932/1870] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:44 2022] DELETE /identity/v3/projects/35e339bbee6e40108ec51035d6d78fc3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:44.397026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.397829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.398372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.418416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:44.419693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.442963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:44.487427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 939/1871] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:44.496389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.496669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.496944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.515192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:44.516431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.525834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 933/1872] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:44.530486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.540910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb47a4e-3d53-40c9-9b99-ae694acf7101 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.546714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.547332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.547663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.547937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.548709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:44.549066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.550883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.564325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 940/1873] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:38:44.569074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.579078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7317b-a08f-4c5e-b439-258ffc60d098 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.584918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.585591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.585872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.586143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.586870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.588835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.616323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 934/1874] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:44.620934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.632732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93064c9-66fa-44ed-a9b5-d1bff5c73c63 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.671577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.673297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.691245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:44.700865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.701588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.701930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.702709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.703478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.706553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.733237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 941/1875] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:44.737434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.748418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e414c-d64c-42e3-b68e-5df252ed5347 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.753908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.754812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.755973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.756286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.756964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055eaf9-3cb8-4858-99a9-991e76c5900d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.757072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.758685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.763198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.764923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.765201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.765473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] PATH_INFO: `/v3/projects/44011b865b1341d3a4d07cf5b1a320a7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.767018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44011b865b1341d3a4d07cf5b1a320a7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.769224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.771581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 942/1876] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:44.774596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.803679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6ce93-3f8f-4f5f-a743-849aa0ed8913 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.810036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.810706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.810986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.811262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.812083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.813832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.829790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 943/1877] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:44.835173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:44.850184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44011b865b1341d3a4d07cf5b1a320a7', 'request_id': 'req-7f10b126-012c-4251-923b-759dde485d77'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.850443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c09c3-b258-4b81-928a-b5d623faa26c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:44.871260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44011b865b1341d3a4d07cf5b1a320a7', 'request_id': 'req-7f10b126-012c-4251-923b-759dde485d77'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.891964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44011b865b1341d3a4d07cf5b1a320a7', 'request_id': 'req-7f10b126-012c-4251-923b-759dde485d77'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.923306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] The token cache is being invalidate because project 44011b865b1341d3a4d07cf5b1a320a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:44.923646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.929825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f10b126-012c-4251-923b-759dde485d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:44.934416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 935/1878] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:44 2022] DELETE /identity/v3/projects/44011b865b1341d3a4d07cf5b1a320a7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:44.941824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f691-1f07-4b0d-b635-a2a5715065c1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.942119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f691-1f07-4b0d-b635-a2a5715065c1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.942393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f691-1f07-4b0d-b635-a2a5715065c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.945800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:44.946914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.947280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.947570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] PATH_INFO: `/v3/projects/d9769fa3b0f54312a4fd6a0a1d5937a5/users/0dcbe0b451b14861b1611e31ef562b97/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:44.971343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9769fa3b0f54312a4fd6a0a1d5937a5, user_id=0dcbe0b451b14861b1611e31ef562b97, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:44.975908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444b939-5e09-41ba-a2ac-75f1ae10f83e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:44.979846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e5f5f691-1f07-4b0d-b635-a2a5715065c1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:44.981161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e5f5f691-1f07-4b0d-b635-a2a5715065c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:44.990869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 936/1879] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:44.998259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:44.998549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:44.998832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.007582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 944/1880] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:44 2022] PUT /identity/v3/projects/d9769fa3b0f54312a4fd6a0a1d5937a5/users/0dcbe0b451b14861b1611e31ef562b97/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:45.018774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.019065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.019561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.026044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:45.027300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.032187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.061483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] MFA Rules not processed for user `0dcbe0b451b14861b1611e31ef562b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:45.061483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.132195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 937/1881] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:45.141447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.162862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 945/1882] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:45.167171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.167956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8d06-c9da-47da-9e75-4a7010e12614 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.168760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.191920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.192663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.193008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.193326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.194522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:45.194839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.196155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630524-53be-4699-bfe3-ac9bc3b697d3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.196508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.206670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.207355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.207682 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.208472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.211392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.215359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 938/1883] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:45.216624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.218737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.233345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f912-7f41-4d51-9d7a-af715f5fdafe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.240784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.242227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.242653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.243700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.244737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.253295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.290071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 946/1884] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:45.294227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.304008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 939/1885] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:45.308363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.317964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.379608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920f69-5c68-4733-850b-7c7ab43c5cb9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.433949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4299-52f5-4573-8a1c-4aca568a6907 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.444355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.445183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.445528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.445868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.447191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.449352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.481412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 940/1886] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:45.486718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.487853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.488671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.489017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.489397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.490162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.492305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.500634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2960-224e-46f2-8415-26cb8cbf44ed admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.507054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.507761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.508070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.508343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.509098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.510726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.518544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 947/1887] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:45.523181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.528208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 941/1888] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:45.532657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.539563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdfd6-5332-497f-b24c-16f71dc06b48 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.545595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7189-2e93-4cd9-aa48-0d0f270d395d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.545713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.546635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.547076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.547335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.548141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.549906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.553452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.553906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.554788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.555366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.555848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.558145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.560389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.568223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 948/1889] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:45.569471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.578983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 942/1890] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:45.580301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.585073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3993-1291-4faa-8fc4-6f99c89d70d1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.589756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.590427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.590709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.591265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.592035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.593893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.594157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a072-0026-422d-9381-5b99595bad20 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.599786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.600919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.601390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.601669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] PATH_INFO: `/v3/projects/0615e2b80346466fa7f4d644942508c8/users/6ad6d24f23d3439cbbed17c719ff5223/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.609700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 949/1891] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:45.620518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.628832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0615e2b80346466fa7f4d644942508c8, user_id=6ad6d24f23d3439cbbed17c719ff5223, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.633545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecb107-2331-4c97-a832-c53d1b60877b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.636386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152abe-b341-45df-a6d3-393c33b08206 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.644062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.645278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.645568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.645924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] PATH_INFO: `/v3/projects/ee022974f3e64320bee7d4a8501de446/users/ae3249f85ec84e7285e7865b6151d319/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.653118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 943/1892] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:45 2022] PUT /identity/v3/projects/0615e2b80346466fa7f4d644942508c8/users/6ad6d24f23d3439cbbed17c719ff5223/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:45.665113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.665411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.665665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.670045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee022974f3e64320bee7d4a8501de446, user_id=ae3249f85ec84e7285e7865b6151d319, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.673572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5665de-adc4-49cf-9f3d-51bb009b28b3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.690931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 950/1893] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:45 2022] PUT /identity/v3/projects/ee022974f3e64320bee7d4a8501de446/users/ae3249f85ec84e7285e7865b6151d319/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:45.702322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.702936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.702936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.704559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] MFA Rules not processed for user `6ad6d24f23d3439cbbed17c719ff5223`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:45.705825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.737621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] MFA Rules not processed for user `ae3249f85ec84e7285e7865b6151d319`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:45.739200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.805996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 944/1894] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:45.810686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.830055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 951/1895] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:45.835248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.874498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.924391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a417-2d86-45c2-adc3-2b147f65e970 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.927129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.927880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff254f-a8b2-4e47-b2c6-3cf8334424fd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.927991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.928816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.929254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.929933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.933038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.936702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.938548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.938843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.940180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.940897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.943702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.981278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 952/1896] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:45.985695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.987023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 945/1897] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:45.991452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.038147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.069818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18683-2ab7-4298-a3cd-37127b187028 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.085436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b498-f741-47ca-bb7c-e0d95c5c4363 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.094056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.094835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.095182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.095681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.097134 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.099602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.136782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 946/1898] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:46.140645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.153289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e05d-1898-4bb3-81e2-b91abe5be6d1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.159693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.160976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.160976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.161196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.161899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.163646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.169156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.170097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.171290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.171896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.172794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.178081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 947/1899] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:46.179423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.184990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.195940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50322e2-6c92-4d08-b4f8-83db57804198 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.202773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.203364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 953/1900] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:45 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:46.203744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.204027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.204308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] PATH_INFO: `/v3/projects/2884964cb47546c29008a9c2faa87c72/users/59a0772143654d968e8a9ae88df3309c/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.207038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.226440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2884964cb47546c29008a9c2faa87c72, user_id=59a0772143654d968e8a9ae88df3309c, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.229252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.234965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329ef63-d2f9-4deb-a863-2ee9ea93144d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.247660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.248533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.248932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.249310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.249748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 948/1901] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:46 2022] PUT /identity/v3/projects/2884964cb47546c29008a9c2faa87c72/users/59a0772143654d968e8a9ae88df3309c/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:46.250314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.253213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.253517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.273465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 954/1902] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:46.274857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.286087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b6d32-7b82-4471-bdd1-3cce4d4f08a1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.373694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a0be-7299-4598-bb6b-e1ba44d1bcd0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.380118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.381044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.381427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.381827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.382650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.383955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.384495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.384863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.385141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.385412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] PATH_INFO: `/v3/projects/d5275aeae30b4b7fa42c7889656b72d5/users/be54e3901ec64d41a08e083216ddd68f/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.399610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 949/1903] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:46.400632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.403216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5275aeae30b4b7fa42c7889656b72d5, user_id=be54e3901ec64d41a08e083216ddd68f, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.406281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.410912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e509-71c2-43db-a117-260fb0d51b19 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.416843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.417819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.418176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.418519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] PATH_INFO: `/v3/projects/2884964cb47546c29008a9c2faa87c72/users/59a0772143654d968e8a9ae88df3309c/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.420875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2884964cb47546c29008a9c2faa87c72, user_id=59a0772143654d968e8a9ae88df3309c, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.424019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4add09-23c1-4cda-8748-c62c94c6ee56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.428467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 955/1904] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:46 2022] PUT /identity/v3/projects/d5275aeae30b4b7fa42c7889656b72d5/users/be54e3901ec64d41a08e083216ddd68f/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:46.430589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.432548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.437132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 950/1905] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:46 2022] PUT /identity/v3/projects/2884964cb47546c29008a9c2faa87c72/users/59a0772143654d968e8a9ae88df3309c/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:46.449215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.449639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.450011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.487295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] MFA Rules not processed for user `59a0772143654d968e8a9ae88df3309c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:46.489062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.493623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.511312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25716cf-0f73-4d34-abce-11602d2a0951 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.575435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 951/1906] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:46.575843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.576519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.576806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.577084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.577849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.579699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.588518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.589985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.594649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 956/1907] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:46.595648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.606223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb53e9-324f-4dd8-bf39-2033bfb8e9d9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.611625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.612575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.612858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.613216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] PATH_INFO: `/v3/projects/d5275aeae30b4b7fa42c7889656b72d5/users/be54e3901ec64d41a08e083216ddd68f/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.615740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5275aeae30b4b7fa42c7889656b72d5, user_id=be54e3901ec64d41a08e083216ddd68f, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.618539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7bb9-706f-470f-8cac-efdd14274da3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.630390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 957/1908] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:46 2022] PUT /identity/v3/projects/d5275aeae30b4b7fa42c7889656b72d5/users/be54e3901ec64d41a08e083216ddd68f/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:38:46.642156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.642475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.642755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.667919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6673b05-42d8-4873-87bb-0f7e423cac05 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.675463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] MFA Rules not processed for user `be54e3901ec64d41a08e083216ddd68f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:46.677160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.723451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.724266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.724829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.725186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.758368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 958/1909] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:46.784409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.803281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.804774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.814285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 952/1910] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:46.815484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.816909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.829355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b4bd-428d-4124-8d37-f2b220e70b1c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.833146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.833905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.834212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.834489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.864338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.873083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c08ce-cf56-4da1-b13c-ef7e019f4b80 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.876893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.877540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.877818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.878091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.897543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.898991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.904040 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.910794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 959/1911] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:46.938640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.940157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50416ed3-187b-42af-94a0-c4c7b23ec0c1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.950719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 953/1912] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:50.452856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:50.516439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64364f-9fb8-4309-ad91-42f0f92d74de service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:50.520981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:50.521951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:50.522583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:50.522851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] PATH_INFO: `/v3/users/6ad6d24f23d3439cbbed17c719ff5223` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:50.524073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad6d24f23d3439cbbed17c719ff5223)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:50.526000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:50.573853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad6d24f23d3439cbbed17c719ff5223'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:50.574407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad6d24f23d3439cbbed17c719ff5223'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:50.574991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad6d24f23d3439cbbed17c719ff5223'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:50.586677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad6d24f23d3439cbbed17c719ff5223'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:50.593423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad6d24f23d3439cbbed17c719ff5223'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:50.607017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 960/1913] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:50 2022] DELETE /identity/v3/users/6ad6d24f23d3439cbbed17c719ff5223 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:50.613762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:50.614252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:50.614338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:50.635357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:50.636677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:50.701746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 954/1914] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:50.711762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:50.713245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:50.777494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2dff-71cc-4dd4-8f03-d4c7874e73c7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:50.781991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:50.782639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:50.783492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:50.783492 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:50.793637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:50.795309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:50.805319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 961/1915] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:51.120783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:51.122399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:51.146546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b447f4-6d91-4b0e-a652-ffec6ffcdef2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:51.151918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:51.153734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:51.153734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:51.153734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] PATH_INFO: `/v3/projects/0615e2b80346466fa7f4d644942508c8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:51.154868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0615e2b80346466fa7f4d644942508c8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:51.157611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:51.222287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0615e2b80346466fa7f4d644942508c8', 'request_id': 'req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.229345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0615e2b80346466fa7f4d644942508c8', 'request_id': 'req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.235904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0615e2b80346466fa7f4d644942508c8', 'request_id': 'req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.250616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] The token cache is being invalidate because project 0615e2b80346466fa7f4d644942508c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:51.250971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.251789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.253812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 955/1916] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:51 2022] DELETE /identity/v3/projects/0615e2b80346466fa7f4d644942508c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:51.260845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:51.271648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca232-2d2c-480c-90f7-e72b9face85d service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:51.293028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:51.338674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:51.339511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:51.339876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:51.340155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] PATH_INFO: `/v3/users/59a0772143654d968e8a9ae88df3309c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:51.341358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a0772143654d968e8a9ae88df3309c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:51.343287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:51.400653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a0772143654d968e8a9ae88df3309c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.401397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a0772143654d968e8a9ae88df3309c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.402086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a0772143654d968e8a9ae88df3309c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.414124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a0772143654d968e8a9ae88df3309c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.420941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d9348d29-6dc9-4bef-95ce-cadd614da4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a0772143654d968e8a9ae88df3309c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.436048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 962/1917] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:51 2022] DELETE /identity/v3/users/59a0772143654d968e8a9ae88df3309c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:51.714437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:51.715973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:51.729212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ccbcd-fc5e-4b32-8792-19bcc13a0d43 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:51.738093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:51.791196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:51.792109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:51.792392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:51.792678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] PATH_INFO: `/v3/projects/2884964cb47546c29008a9c2faa87c72` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:51.793878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2884964cb47546c29008a9c2faa87c72)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:51.795887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:51.845988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2884964cb47546c29008a9c2faa87c72', 'request_id': 'req-98c0db67-ebc0-4a86-b2c1-71d17331a217'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.852190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2884964cb47546c29008a9c2faa87c72', 'request_id': 'req-98c0db67-ebc0-4a86-b2c1-71d17331a217'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.857570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2884964cb47546c29008a9c2faa87c72', 'request_id': 'req-98c0db67-ebc0-4a86-b2c1-71d17331a217'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.871440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] The token cache is being invalidate because project 2884964cb47546c29008a9c2faa87c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:51.871750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.872365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98c0db67-ebc0-4a86-b2c1-71d17331a217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:51.874119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 956/1918] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:51 2022] DELETE /identity/v3/projects/2884964cb47546c29008a9c2faa87c72 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:51.878853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:51.879371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:51.879371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:51.898396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:51.899595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:51.959090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 963/1919] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:51.966988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:51.967208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:51.967483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:51.986426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:51.987767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:51.996841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 957/1920] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:52.001253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.010613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb068af-dc62-419b-a818-e79f8c99113f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.015059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.015744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.016020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.016299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.017016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:52.017314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.019034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.031290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 964/1921] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:52.035716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.045038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c609bbe-ccd7-4e6d-b5e2-2012eaf1d8dc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.049697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.050353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.050631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.050899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.051634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.053605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.080234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 958/1922] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:52.084984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.095416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64419-436f-4dbe-a298-db1e183cf005 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.121830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:52.156812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.157486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.157767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.158081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.158709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.160674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.181502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 965/1923] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:52.186587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.197357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138c45-49d3-4d24-bc3c-cdc0071241d4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.202091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.202756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.203032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.203305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.204059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.205645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.216471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 959/1924] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:52.220558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.230818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136552-4bfd-4b7f-9be2-6344077eb594 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.235948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.236619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.236904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.237210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.237934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.239643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034722c-7c00-4c0c-a2ed-bb21befab64c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.249784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 966/1925] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:52.254017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.264467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d46-4474-4673-846b-c9cb861d0426 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.269253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.270141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.270420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.271079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] PATH_INFO: `/v3/projects/4fbed3de4d134d16be96b7992b5bba58/users/6de0f45409024c848955aec349aecce2/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.285984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbed3de4d134d16be96b7992b5bba58, user_id=6de0f45409024c848955aec349aecce2, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.288962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.305048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 960/1926] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:52 2022] PUT /identity/v3/projects/4fbed3de4d134d16be96b7992b5bba58/users/6de0f45409024c848955aec349aecce2/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:52.315102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.315397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.315733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.353927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] MFA Rules not processed for user `6de0f45409024c848955aec349aecce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:52.355171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:52.442725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 967/1927] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:52.447422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.490571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:52.514019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128e43-f03b-431a-bd4a-3062f05d6d03 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.520244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.520902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.521177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.521458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.522986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.525341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.560287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 961/1928] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:52.565076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.579805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3470519-bbd3-49ed-88a9-9c4ff5306fa6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.644620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.645298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.645594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.645868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.646932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.649511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.670523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 968/1929] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:52.674630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.685564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd97bd-537c-4d7d-bf75-7999d01319e9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.690236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.690901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.691185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.691462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.692274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.693930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.705443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 962/1930] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:52.709776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.720172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64a86-b516-4d8e-90a0-6270bc28a2fe admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.725857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.726767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.727030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.727342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] PATH_INFO: `/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb/users/01c748bae0b54b0fa672372d73346b38/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.743958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4ccb6b39a64e29ae10ed324fa6b6cb, user_id=01c748bae0b54b0fa672372d73346b38, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.746754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.760520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 969/1931] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:52 2022] PUT /identity/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb/users/01c748bae0b54b0fa672372d73346b38/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:52.764724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.776563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de00ef-2ddb-40a2-8447-805bc63cbc34 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.840389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.841054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.841328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.841585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.842306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.843949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618da1-db8d-4217-9950-9a6b81d985ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.854682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 963/1932] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:52.861639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:52.869142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:52.874792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8209e5-dbda-4a3b-afbf-96ff813eb53c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:52.880275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:52.881230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.881507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.881780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] PATH_INFO: `/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb/users/01c748bae0b54b0fa672372d73346b38/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.883793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4ccb6b39a64e29ae10ed324fa6b6cb, user_id=01c748bae0b54b0fa672372d73346b38, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:52.886466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:52.897712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 970/1933] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:52 2022] PUT /identity/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb/users/01c748bae0b54b0fa672372d73346b38/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:52.908831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.909120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.909386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.935367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] MFA Rules not processed for user `01c748bae0b54b0fa672372d73346b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:52.936615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:53.015429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 964/1934] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:53.026929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:53.028872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:53.087583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0f8b-c0ae-46dc-99d5-0f6ff5eb1498 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:53.091321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:53.092023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:53.092318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:53.092566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:53.102154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:53.103637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:53.113277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 971/1935] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:53.191887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:53.201753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a7ce2-aed1-4a91-9521-c557d353f431 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:53.205579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:53.206303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:53.206614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:53.206863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:53.239984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:53.269751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:53.271262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:53.283378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 965/1936] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:56.062912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:56.064494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:56.075693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f889b-38e4-4793-ac3c-fce3f576ae06 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:56.079336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:56.080012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:56.080291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:56.080555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:56.082886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:56.157809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:56.159607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:56.170927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 972/1937] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:56.778066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:56.789654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdca0a-1b55-4d22-9d6c-8ac76feb4599 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:56.794750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:56.795777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:56.796071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:56.796371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:56.798461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:56.875315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:56.876847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00875a-d487-48b1-a935-07ada1515dc0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:56.887227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 966/1938] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:57.229815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:57.231664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:57.306585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177facb3-0153-437a-8261-1e24badb1d1f service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:57.311275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:57.312278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:57.312651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:57.312994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] PATH_INFO: `/v3/users/197344f04a0f40e5b7e4a15cbb8ad624` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:57.314212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197344f04a0f40e5b7e4a15cbb8ad624)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:57.316367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:57.355561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:57.371693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197344f04a0f40e5b7e4a15cbb8ad624'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.372395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197344f04a0f40e5b7e4a15cbb8ad624'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.372937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197344f04a0f40e5b7e4a15cbb8ad624'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.389910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197344f04a0f40e5b7e4a15cbb8ad624'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.396530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197344f04a0f40e5b7e4a15cbb8ad624'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.410291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 973/1939] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:57 2022] DELETE /identity/v3/users/197344f04a0f40e5b7e4a15cbb8ad624 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:57.415135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:57.415424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:57.415733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:57.433736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:57.434947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:57.505712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 967/1940] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:57.515759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:57.517222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:57.579444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b65ae-5514-481f-bb08-023b6a5e78d7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:57.583678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:57.584334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:57.584632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:57.584903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:57.594523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:57.596029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:57.606100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 974/1941] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:57.880543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:57.882618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:57.896668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547d79d-b036-4113-bea7-f1e610ebfcea None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:57.902870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:57.903694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:57.903953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:57.904235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] PATH_INFO: `/v3/projects/f8a7391514f64de7beba2e1ccadeb8ba` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:57.905477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a7391514f64de7beba2e1ccadeb8ba)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:57.907470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:57.958174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a7391514f64de7beba2e1ccadeb8ba', 'request_id': 'req-ea6d9b28-9140-4268-a02d-54737373db6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.965352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a7391514f64de7beba2e1ccadeb8ba', 'request_id': 'req-ea6d9b28-9140-4268-a02d-54737373db6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.970235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:57.971602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a7391514f64de7beba2e1ccadeb8ba', 'request_id': 'req-ea6d9b28-9140-4268-a02d-54737373db6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.986187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] The token cache is being invalidate because project f8a7391514f64de7beba2e1ccadeb8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:57.986469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.987448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:57.989225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 968/1942] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:57 2022] DELETE /identity/v3/projects/f8a7391514f64de7beba2e1ccadeb8ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:57.993870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:58.004340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05f7bd-73df-4661-96ed-5219648d46fc service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:58.080315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:58.081581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:58.082099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:58.082717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] PATH_INFO: `/v3/users/c78605d7382a47c39483783ef5d4b005` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:58.084120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78605d7382a47c39483783ef5d4b005)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:58.086904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:58.149988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78605d7382a47c39483783ef5d4b005'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.150673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78605d7382a47c39483783ef5d4b005'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.151337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78605d7382a47c39483783ef5d4b005'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.160442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:58.172847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78605d7382a47c39483783ef5d4b005'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.181979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bcba8e54-dd80-48d8-af44-2d58ea9029ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78605d7382a47c39483783ef5d4b005'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.200343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 975/1943] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:57 2022] DELETE /identity/v3/users/c78605d7382a47c39483783ef5d4b005 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:58.689019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:58.692850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:58.706592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9b28-9140-4268-a02d-54737373db6f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:58.808219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:58.809320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:58.809604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:58.809879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] PATH_INFO: `/v3/projects/3995f4f3b49f46bda939d19ec9021b6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:58.811106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3995f4f3b49f46bda939d19ec9021b6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:58.813741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:58.873233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3995f4f3b49f46bda939d19ec9021b6c', 'request_id': 'req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.879756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3995f4f3b49f46bda939d19ec9021b6c', 'request_id': 'req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.885299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3995f4f3b49f46bda939d19ec9021b6c', 'request_id': 'req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.900404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] The token cache is being invalidate because project 3995f4f3b49f46bda939d19ec9021b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:38:58.900668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.901392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:58.903292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 969/1944] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:58 2022] DELETE /identity/v3/projects/3995f4f3b49f46bda939d19ec9021b6c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:58.908857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea148-014f-4bcd-919c-dc2244af21e7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:58.909342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea148-014f-4bcd-919c-dc2244af21e7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:58.909342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea148-014f-4bcd-919c-dc2244af21e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:58.929475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3c1ea148-014f-4bcd-919c-dc2244af21e7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:58.930666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c1ea148-014f-4bcd-919c-dc2244af21e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:58.936663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:58.938116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:58.990812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 976/1945] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:58.999022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:58.999397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:58.999744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.004469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c50d-4fec-4f65-95f7-08ca981ee0ed admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.010298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.011181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.011460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.011873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] PATH_INFO: `/v3/users/02a69c23a77f4f0395bf8f3b0edf6955` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.013072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a69c23a77f4f0395bf8f3b0edf6955)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.015003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.018385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:59.019656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.028567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 977/1946] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:59.032763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.038446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:59.042217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac484-f29c-4030-b0a7-27788e2f02a8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.048849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.049944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.050274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.050596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.051343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:38:59.051716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.054364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.067043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 978/1947] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:38:59.071903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a69c23a77f4f0395bf8f3b0edf6955'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:59.072162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.072697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a69c23a77f4f0395bf8f3b0edf6955'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:59.074199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.079985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a69c23a77f4f0395bf8f3b0edf6955'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:59.086937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552f7d-bcc4-428e-bfb1-0a429f5d98c5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.091828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a69c23a77f4f0395bf8f3b0edf6955'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:59.092107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.092532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c9a0d687-aaf3-4520-9abe-bed1842dacbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a69c23a77f4f0395bf8f3b0edf6955'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:38:59.092756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.093036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.093327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.094112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.096092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.106686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 970/1948] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:38:58 2022] DELETE /identity/v3/users/02a69c23a77f4f0395bf8f3b0edf6955 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:59.111240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.111573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.111856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.126484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 979/1949] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:59.127594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.129920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:59.131159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.192852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e9d-9fe8-4ecb-bf17-19600cb7ded4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.198009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.198265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 971/1950] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:59.198900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.199176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.199457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.200233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.202370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.209629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.211748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.224357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 980/1951] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:38:59.232476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.242961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1b01-b8c5-4309-9127-fc0588894533 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.248214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.249010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.249213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.249486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.250534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.252142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.266647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 981/1952] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:38:59.272571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.285079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8954b-ece6-4dfd-a72f-4549e22aeb6e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.291464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.292926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.293401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.293853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.294730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.297135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.299813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:59.301684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e61de-7a02-4787-8cfb-8d29194a77c5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.310761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.312089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.312697 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.313386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.315833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 982/1953] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:38:59.322195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.331702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.333471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e23fe-ee88-4c88-9ee8-2e6bcaabee27 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.335804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321e56-4ff5-47a5-9e97-bef2dbd416ad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.344174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 972/1954] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:59.344337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.345449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.345941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.346431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] PATH_INFO: `/v3/projects/ea9377f9467a47638ac2a43a11b51d6a/users/afa9acd8e92844d7a6db66ccce22299d/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.372135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9377f9467a47638ac2a43a11b51d6a, user_id=afa9acd8e92844d7a6db66ccce22299d, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.374896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.407836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 983/1955] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:38:59 2022] PUT /identity/v3/projects/ea9377f9467a47638ac2a43a11b51d6a/users/afa9acd8e92844d7a6db66ccce22299d/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:38:59.425364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.425780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.426183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.458448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] MFA Rules not processed for user `afa9acd8e92844d7a6db66ccce22299d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:59.459831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.499859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:59.564579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 973/1956] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:59.569154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.667756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9968-f7fb-4a1b-8569-1fcac254505a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.673778 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.675485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.675802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.676227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.677014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.679528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:59.746121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 984/1957] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:38:59.750093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.770862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97245f75-5b1d-4f76-aca3-7d1af00604f7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:59.885435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:59.887580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:59.936385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:59.937205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:59.937491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:59.937760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:59.948080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:59.958813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.045515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 974/1958] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:38:59 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:00.049480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.075298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb09a7-1bca-4068-85d8-de7e7e746dfb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.091312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.093782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.095777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.098415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.101152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.105692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.131874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f1a4-fdcf-43ae-848c-14be61274784 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.136500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 975/1959] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:00.137488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.140337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.149080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.149984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.150263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.150540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] PATH_INFO: `/v3/projects/e9c3329146234c1eb41c48a676bef13c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.154912 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c3329146234c1eb41c48a676bef13c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.160957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.161185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131c051-1ec2-42fe-a77e-c8eef469ef0d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.168238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.169690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.169690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.169885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] PATH_INFO: `/v3/users/6de0f45409024c848955aec349aecce2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.171291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de0f45409024c848955aec349aecce2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.174566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.292403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c3329146234c1eb41c48a676bef13c', 'request_id': 'req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.299252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de0f45409024c848955aec349aecce2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.301314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de0f45409024c848955aec349aecce2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.303591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c3329146234c1eb41c48a676bef13c', 'request_id': 'req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.310323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:00.312482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c3329146234c1eb41c48a676bef13c', 'request_id': 'req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.316458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de0f45409024c848955aec349aecce2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.338195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de0f45409024c848955aec349aecce2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.339402 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8563a014-122f-4115-ab51-b2be0d6350ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de0f45409024c848955aec349aecce2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.353646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] The token cache is being invalidate because project e9c3329146234c1eb41c48a676bef13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:00.353646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.355487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.362211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 985/1961] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:38:59 2022] DELETE /identity/v3/projects/e9c3329146234c1eb41c48a676bef13c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:00.363162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 976/1961] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:00 2022] DELETE /identity/v3/users/6de0f45409024c848955aec349aecce2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:00.364755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.365388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.366273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.366891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.371716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.389232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:00.390985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.432253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:00.509987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 977/1962] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:00.511106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.512569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.528166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e693a9-c53a-4ba8-b4d4-7460792a9fa1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.533804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c77cb-1001-43f6-ba51-0f431e8cbd01 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.535831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.538044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.538477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.539056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] PATH_INFO: `/v3/users/45bef9c5cb084717a680e6a4c917cad6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.541028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bef9c5cb084717a680e6a4c917cad6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.542089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.542781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.543063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.543338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.544183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.544302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.546143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.558920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 986/1963] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:00.559783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.561459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.617460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bef9c5cb084717a680e6a4c917cad6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.618264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bef9c5cb084717a680e6a4c917cad6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.629817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bef9c5cb084717a680e6a4c917cad6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.637742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209664d-a309-4ae2-a014-21fea865b99c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.642116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.642780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.643091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.643364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.645971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.649147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bef9c5cb084717a680e6a4c917cad6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.649914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bef9c5cb084717a680e6a4c917cad6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:00.662790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.664677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd0f02-502a-443d-8d3e-6fc63bd01d73 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.666663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 978/1964] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:00 2022] DELETE /identity/v3/users/45bef9c5cb084717a680e6a4c917cad6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:00.668704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:00.672571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:00.676782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 987/1965] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:00.765970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac903-d485-4367-9d7b-612c5a87c5dd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:00.780281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:00.781225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.781507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.781782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] PATH_INFO: `/v3/projects/07bbd36bd9654c439eb0e5470f389ddd/users/302b0408a0444d1cabd9e4df9264c0c3/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.835179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bbd36bd9654c439eb0e5470f389ddd, user_id=302b0408a0444d1cabd9e4df9264c0c3, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:00.838739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:00.892978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 979/1966] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:00 2022] PUT /identity/v3/projects/07bbd36bd9654c439eb0e5470f389ddd/users/302b0408a0444d1cabd9e4df9264c0c3/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:00.901208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:00.901380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:00.901702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:00.955132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] MFA Rules not processed for user `302b0408a0444d1cabd9e4df9264c0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:00.956532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.043384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 988/1967] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:01.049000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.077474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:01.164730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1a356-2567-473a-9585-34e98f8ff1f8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.177336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.180124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.180648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.180952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.182582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.186231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.206446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.208087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.258812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6704-63d9-40e0-9bc1-618ed33678eb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.270243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 980/1968] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:01.273851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.275035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.275322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.275660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] PATH_INFO: `/v3/projects/d70174963aa0458db6efb7784fb50bca` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.276010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.276972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70174963aa0458db6efb7784fb50bca)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.278918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.302598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:01.351125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70174963aa0458db6efb7784fb50bca', 'request_id': 'req-29fc8af9-9f0e-4d48-8870-1943b5ec0477'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.358095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70174963aa0458db6efb7784fb50bca', 'request_id': 'req-29fc8af9-9f0e-4d48-8870-1943b5ec0477'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.364564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70174963aa0458db6efb7784fb50bca', 'request_id': 'req-29fc8af9-9f0e-4d48-8870-1943b5ec0477'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.375607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fad99-cc11-41f0-acfe-8294db74c0eb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.380219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] The token cache is being invalidate because project d70174963aa0458db6efb7784fb50bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:01.380511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.381991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.384241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 989/1969] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:01 2022] DELETE /identity/v3/projects/d70174963aa0458db6efb7784fb50bca => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:01.385050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.386706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.447676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.448754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.449255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.449715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.450938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.453277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33177406-9521-44c0-bea8-5c19fa0cece1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.466884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc8af9-9f0e-4d48-8870-1943b5ec0477 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.482394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 981/1970] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:01.482574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.482574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.482574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.482869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] PATH_INFO: `/v3/users/0dcbe0b451b14861b1611e31ef562b97` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.484157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.485207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.485590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.485734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcbe0b451b14861b1611e31ef562b97)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.490025 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.518940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:01.520227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.539895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 982/1971] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:01.541064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.542599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.558179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a75c8-eca6-4ef4-9e76-703bbe631d14 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.583234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcbe0b451b14861b1611e31ef562b97'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.584055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcbe0b451b14861b1611e31ef562b97'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.587373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcbe0b451b14861b1611e31ef562b97'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.589394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.590629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.590912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.591184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.591961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.594667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893319-c17c-4717-a236-1cf086172b10 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.611116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcbe0b451b14861b1611e31ef562b97'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.626437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 983/1972] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:01.626437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c28b8-3e0b-4776-b146-996309a2253a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.630050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c28b8-3e0b-4776-b146-996309a2253a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.630050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c28b8-3e0b-4776-b146-996309a2253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.633245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcbe0b451b14861b1611e31ef562b97'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.660936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-454c28b8-3e0b-4776-b146-996309a2253a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:01.662532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-454c28b8-3e0b-4776-b146-996309a2253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.665815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 990/1973] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:01 2022] DELETE /identity/v3/users/0dcbe0b451b14861b1611e31ef562b97 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:01.667161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.669305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.684799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:01.698387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:01.764786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222115-844e-45b5-8719-56d3d813df45 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.766768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 984/1974] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:01.768454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.769066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.769902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.774641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.776176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.777753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.778078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] PATH_INFO: `/v3/projects/7758d2457ca6438f95a4625017aecb25/users/d3ed0704f24c4cf895b4d7ca82f1f700/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.800844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7758d2457ca6438f95a4625017aecb25, user_id=d3ed0704f24c4cf895b4d7ca82f1f700, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.803651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.808034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:01.809881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.822309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 985/1975] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:01.822309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.822309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.831238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 991/1976] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:01 2022] PUT /identity/v3/projects/7758d2457ca6438f95a4625017aecb25/users/d3ed0704f24c4cf895b4d7ca82f1f700/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:01.831238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.837256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828037d-f097-4429-9db1-0c47ecdf2ff6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.898939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f2c4-d66a-4c4c-9133-1fd674a84f17 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.903619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.904409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.904685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.904956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.905502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.905701 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:01.905970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.906693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.906883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.907126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] PATH_INFO: `/v3/projects/4fbed3de4d134d16be96b7992b5bba58` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.907740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.908517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbed3de4d134d16be96b7992b5bba58)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.910577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.921250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 992/1977] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:01.922445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.924245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.962071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbed3de4d134d16be96b7992b5bba58', 'request_id': 'req-503c8c82-3688-412b-945a-ebe1f52251f7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.969109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbed3de4d134d16be96b7992b5bba58', 'request_id': 'req-503c8c82-3688-412b-945a-ebe1f52251f7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.975269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbed3de4d134d16be96b7992b5bba58', 'request_id': 'req-503c8c82-3688-412b-945a-ebe1f52251f7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.992062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c93d-5328-47c6-917f-6d37c000b97d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.992296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] The token cache is being invalidate because project 4fbed3de4d134d16be96b7992b5bba58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:01.992577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.993550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:01.996382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 986/1978] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:01 2022] DELETE /identity/v3/projects/4fbed3de4d134d16be96b7992b5bba58 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:01.997481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.998852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.071419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.072163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.073041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.073321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.075512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.082001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.082914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.102326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8c82-3688-412b-945a-ebe1f52251f7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.126090 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.127071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.127500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.127500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.128281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.129944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.155574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 987/1979] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:02.159786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.163385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.188040 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.191031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.194776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878832-7d39-400e-84f2-60bd151ce555 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.206606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 993/1980] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:02.207259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.208712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.208927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.209213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.210011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.212638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.216971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.223598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.248905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 988/1981] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:02 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:02.248905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.273718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6369b-1938-4cf9-bbb3-e8ae110524ea service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.321738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5f79-125b-4bf1-8f95-91679a15e29f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.327155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.328380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.328500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.328698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] PATH_INFO: `/v3/projects/7758d2457ca6438f95a4625017aecb25/users/d3ed0704f24c4cf895b4d7ca82f1f700/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.330910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7758d2457ca6438f95a4625017aecb25, user_id=d3ed0704f24c4cf895b4d7ca82f1f700, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.333840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.365886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 989/1982] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:02 2022] PUT /identity/v3/projects/7758d2457ca6438f95a4625017aecb25/users/d3ed0704f24c4cf895b4d7ca82f1f700/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:02.367042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.435909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.436845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.437192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.437518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] PATH_INFO: `/v3/users/01c748bae0b54b0fa672372d73346b38` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.439140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c748bae0b54b0fa672372d73346b38)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.442126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.464397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136def-cb25-4306-bbdf-8ac649661fc5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.470543 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.471331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.471723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.472069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.472939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.475923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3479-4076-4633-b94e-b4c29c177670 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.522856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 990/1983] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:02 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:02.522856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.522856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.522856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.563081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] MFA Rules not processed for user `d3ed0704f24c4cf895b4d7ca82f1f700`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:02.564670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.575893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c748bae0b54b0fa672372d73346b38'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:02.577866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c748bae0b54b0fa672372d73346b38'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:02.578959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c748bae0b54b0fa672372d73346b38'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:02.601983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c748bae0b54b0fa672372d73346b38'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:02.610863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c748bae0b54b0fa672372d73346b38'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:02.618343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.638638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 994/1984] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:02 2022] DELETE /identity/v3/users/01c748bae0b54b0fa672372d73346b38 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:02.640187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.643276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.696373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.741220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 991/1985] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:02.780970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.782710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:02.802033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6696774-cba2-4bc0-90da-3237c959778c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.823248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.824045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.824387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.827009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.829827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.834394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.853238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf38c1-e4de-4379-8e95-095b3ec62c37 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.860344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 995/1986] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:02.863162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.909052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6dcb1-4059-4132-9e6e-cd25eeac9c3d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:02.941782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:02.943656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:02.944560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:02.944560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:02.945119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:02.946781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:02.987229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 996/1987] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:02.987229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:02.997514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.019132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba3f-9e67-4537-8c86-2540198ce54b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:03.027022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:03.028764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.029121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.029975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.035408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:03.036329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.036612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.036888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] PATH_INFO: `/v3/projects/d9769fa3b0f54312a4fd6a0a1d5937a5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.038252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9769fa3b0f54312a4fd6a0a1d5937a5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:03.040163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:03.046733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.172268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9769fa3b0f54312a4fd6a0a1d5937a5', 'request_id': 'req-e4968c94-b847-4234-8908-330b5b8ed253'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.207683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9769fa3b0f54312a4fd6a0a1d5937a5', 'request_id': 'req-e4968c94-b847-4234-8908-330b5b8ed253'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.225207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9769fa3b0f54312a4fd6a0a1d5937a5', 'request_id': 'req-e4968c94-b847-4234-8908-330b5b8ed253'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.230062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:03.231719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:03.247220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 992/1988] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:03.248348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:03.252625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] The token cache is being invalidate because project d9769fa3b0f54312a4fd6a0a1d5937a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:03.252987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.253866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.257542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 997/1989] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:02 2022] DELETE /identity/v3/projects/d9769fa3b0f54312a4fd6a0a1d5937a5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:03.261630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:03.264618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.271191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e5dc-8b94-4223-afec-a290fc09dfa9 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:03.359494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:03.398056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:03.399414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.400288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.401257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] PATH_INFO: `/v3/projects/79d5ddc1e14e46f7bfa69a33723f8aa6/users/0dd0fec811f04ae38af47d6746859ff6/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.456715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d5ddc1e14e46f7bfa69a33723f8aa6, user_id=0dd0fec811f04ae38af47d6746859ff6, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:03.463999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e5297-4ca7-4e1f-b580-a9e5b8b34561 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:03.480959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4968c94-b847-4234-8908-330b5b8ed253 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:03.497030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:03.497614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 993/1990] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:03 2022] PUT /identity/v3/projects/79d5ddc1e14e46f7bfa69a33723f8aa6/users/0dd0fec811f04ae38af47d6746859ff6/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:03.498066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.498296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.498573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] PATH_INFO: `/v3/users/ae3249f85ec84e7285e7865b6151d319` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.499840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3249f85ec84e7285e7865b6151d319)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:03.501801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:03.508663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.509168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.509589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.598372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:03.617028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] MFA Rules not processed for user `0dd0fec811f04ae38af47d6746859ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:03.620023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.632907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3249f85ec84e7285e7865b6151d319'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.636410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3249f85ec84e7285e7865b6151d319'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.637296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3249f85ec84e7285e7865b6151d319'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.681384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3249f85ec84e7285e7865b6151d319'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.700195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3249f85ec84e7285e7865b6151d319'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:03.739095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 998/1991] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:03 2022] DELETE /identity/v3/users/ae3249f85ec84e7285e7865b6151d319 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:03.741386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:03.745079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.856705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 994/1992] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:03.861126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:03.870701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:03.953057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61138a-13e4-42f1-88fa-470c0b44d31b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:03.959118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:03.960268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:03.960675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:03.960805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] PATH_INFO: `/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:03.963055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4ccb6b39a64e29ae10ed324fa6b6cb)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:03.965078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:03.988612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00c35-6cdf-46a0-ae78-6c07813682db None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.007011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.008704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.010288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.010679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.011567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.017136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.026557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4ccb6b39a64e29ae10ed324fa6b6cb', 'request_id': 'req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.034175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4ccb6b39a64e29ae10ed324fa6b6cb', 'request_id': 'req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.041764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4ccb6b39a64e29ae10ed324fa6b6cb', 'request_id': 'req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.061715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] The token cache is being invalidate because project 5f4ccb6b39a64e29ae10ed324fa6b6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:04.062023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.062741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dec56b9f-dc09-491d-9a90-b1e8ffd5a7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.064456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 999/1993] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:03 2022] DELETE /identity/v3/projects/5f4ccb6b39a64e29ae10ed324fa6b6cb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:04.073621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.073914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.076275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 995/1994] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:03 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:04.079336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.080480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.083915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.130619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:04.131919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.155086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:04.198005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810535b3-dbeb-44e8-bacf-6f914a139298 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.206176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:04.206465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.207129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.207412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.207724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.208528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.210849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.241754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 996/1995] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:04.243477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.247686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.255702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1000/1996] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:04.255702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.267829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e9b7-851a-46f4-90b6-3564883413ab admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.275747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.276640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.276921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.277195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] PATH_INFO: `/v3/projects/ee022974f3e64320bee7d4a8501de446` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.278403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee022974f3e64320bee7d4a8501de446)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.279596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944a2cb-3a92-4840-9f25-1aee4029876e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.280680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.286074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.286865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.287392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.287913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.288926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.291137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e967e8-ce46-4521-bb54-88e5c74da160 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.307625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1001/1997] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:04.308902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.309308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.309616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.333875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:04.335301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.354189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1002/1998] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:04.355483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.362753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee022974f3e64320bee7d4a8501de446', 'request_id': 'req-8101354b-d8d0-4e4c-9119-75c6e842e8c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.365870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfd4e-e9ca-4e96-92df-45258068e102 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.370677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee022974f3e64320bee7d4a8501de446', 'request_id': 'req-8101354b-d8d0-4e4c-9119-75c6e842e8c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.377483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee022974f3e64320bee7d4a8501de446', 'request_id': 'req-8101354b-d8d0-4e4c-9119-75c6e842e8c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.406923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] The token cache is being invalidate because project ee022974f3e64320bee7d4a8501de446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:04.407221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.412010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.415208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 997/1999] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:04 2022] DELETE /identity/v3/projects/ee022974f3e64320bee7d4a8501de446 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:04.419895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.424145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.446340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.448130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.448925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.449400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] PATH_INFO: `/v3/projects/46e0837c983448ee9e8bee4d0053aa95/users/ae3aeba105c544cdab202d4e0ec8ec8b/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.470878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e0837c983448ee9e8bee4d0053aa95, user_id=ae3aeba105c544cdab202d4e0ec8ec8b, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.473843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.495771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1003/2000] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:04 2022] PUT /identity/v3/projects/46e0837c983448ee9e8bee4d0053aa95/users/ae3aeba105c544cdab202d4e0ec8ec8b/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:04.497034 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.500262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.546167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101354b-d8d0-4e4c-9119-75c6e842e8c0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.614898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe058a-f921-47b8-b5e6-3d523e4f8476 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.620099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.620888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.621169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.621446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] PATH_INFO: `/v3/users/be54e3901ec64d41a08e083216ddd68f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.622931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be54e3901ec64d41a08e083216ddd68f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.625231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.651597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:04.660887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.661995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.662933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.663388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.664634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:04.665044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.667224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.687682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 998/2001] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:04.688575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.692558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.695000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be54e3901ec64d41a08e083216ddd68f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.696154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be54e3901ec64d41a08e083216ddd68f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.696999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be54e3901ec64d41a08e083216ddd68f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.699206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:04.717066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be54e3901ec64d41a08e083216ddd68f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.731653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef2e4-8cc5-40ef-8d55-2d65dd430c5f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.731949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be54e3901ec64d41a08e083216ddd68f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:04.736767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.737731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.738172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.738750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.740500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.742753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.744010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1004/2002] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:04 2022] DELETE /identity/v3/users/be54e3901ec64d41a08e083216ddd68f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:04.744960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.751842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.761064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 999/2003] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:04.765406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.768044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:04.786512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121547-f461-4c16-bcdd-3992731f9d27 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.850738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6a6d-6bd7-4c3d-93e3-65540816669a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:04.859812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.860635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.861146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.861528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.862372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.865121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.881976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:04.884724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.885005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.885327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] PATH_INFO: `/v3/projects/46e0837c983448ee9e8bee4d0053aa95/users/ae3aeba105c544cdab202d4e0ec8ec8b/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.891462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e0837c983448ee9e8bee4d0053aa95, user_id=ae3aeba105c544cdab202d4e0ec8ec8b, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:04.898350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691d852-997e-4645-a118-0e5d2a247b57 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:04.912834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1005/2004] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/projects => generated 407 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:04.916567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1000/2005] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:04 2022] PUT /identity/v3/projects/46e0837c983448ee9e8bee4d0053aa95/users/ae3aeba105c544cdab202d4e0ec8ec8b/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:04.917383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:04.927036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:04.927849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:04.928003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:04.976576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] MFA Rules not processed for user `ae3aeba105c544cdab202d4e0ec8ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:04.978340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.059371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404361bd-99a5-4973-80fd-5b4f7a0788c9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.121305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1001/2006] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:05.133236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.136876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.157537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:05.166553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.180691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.180985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.181268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.185260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.190285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.233301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1006/2007] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:04 2022] POST /identity/v3/users => generated 304 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:05.234261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.238403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.253158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c8a6-3a3e-4d3a-9f89-9fa3c66bad72 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.257446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.258098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.258369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.258831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.260550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a7963-77a8-494c-a795-cfe5d000a1c2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.266699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.267614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.267933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.268487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] PATH_INFO: `/v3/projects/d5275aeae30b4b7fa42c7889656b72d5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.270961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5275aeae30b4b7fa42c7889656b72d5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.273451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.277634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.281839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.296666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1002/2008] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:05.297852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.303198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:05.318331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8b6-4edb-4547-8ba6-b0ab30452c55 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.337117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.337117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.337564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.337879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.338793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.341088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.350643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5275aeae30b4b7fa42c7889656b72d5', 'request_id': 'req-2ec7f3d0-ba58-4784-8427-9d32fe28f882'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.353690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1003/2009] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:05.354781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.356673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.360589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5275aeae30b4b7fa42c7889656b72d5', 'request_id': 'req-2ec7f3d0-ba58-4784-8427-9d32fe28f882'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.367430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5275aeae30b4b7fa42c7889656b72d5', 'request_id': 'req-2ec7f3d0-ba58-4784-8427-9d32fe28f882'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.372440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cea52-1f32-4a25-b43e-f6e3c3c52ed5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.385403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] The token cache is being invalidate because project d5275aeae30b4b7fa42c7889656b72d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:05.386044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.386883 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.389585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1007/2010] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:05 2022] DELETE /identity/v3/projects/d5275aeae30b4b7fa42c7889656b72d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:05.390449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.391910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.436913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.437583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.437861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.438160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.440077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.465423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f3d0-ba58-4784-8427-9d32fe28f882 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.470406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.471324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.471634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.471907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.472638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.474254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.484329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1008/2011] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:05.484949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.488857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.501430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce280-eac3-4952-8570-ebb79eb97937 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.506293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.506813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.507733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.508010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.508222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627b49d-a0ad-46d1-a5f6-6c1d950accbb service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.508328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] PATH_INFO: `/v3/users/0dd0fec811f04ae38af47d6746859ff6` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.509459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd0fec811f04ae38af47d6746859ff6)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.511381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.517369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1004/2012] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:05.518722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.519015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.519293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.538600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:05.539962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.555742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1005/2013] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:05.556683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.571877 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579777f0-4a1d-43ff-b95d-bcdd4940e7c9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.578349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.579265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.579571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.579885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] PATH_INFO: `/v3/projects/f2577303518d4626b1d7a91dd5790248/users/0b10c80ff2d34af89a80f75254882d93/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.588738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd0fec811f04ae38af47d6746859ff6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.589832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd0fec811f04ae38af47d6746859ff6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.590871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd0fec811f04ae38af47d6746859ff6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.597793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2577303518d4626b1d7a91dd5790248, user_id=0b10c80ff2d34af89a80f75254882d93, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.602117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:05.602303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ede36-5a2c-415e-a83b-db72f75d0987 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.604886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd0fec811f04ae38af47d6746859ff6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.617744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-974f93a5-fe00-40e0-80ed-2dc75b47f381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd0fec811f04ae38af47d6746859ff6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:05.619758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1006/2014] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:05 2022] PUT /identity/v3/projects/f2577303518d4626b1d7a91dd5790248/users/0b10c80ff2d34af89a80f75254882d93/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:05.621222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01a15-0f76-4a40-9943-a2a8fb2c4ea8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.621527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01a15-0f76-4a40-9943-a2a8fb2c4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.621802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01a15-0f76-4a40-9943-a2a8fb2c4ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.641889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-23d01a15-0f76-4a40-9943-a2a8fb2c4ea8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:05.643252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-23d01a15-0f76-4a40-9943-a2a8fb2c4ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.648685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1009/2015] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:05 2022] DELETE /identity/v3/users/0dd0fec811f04ae38af47d6746859ff6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:05.651460 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.652157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.652472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.688122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] MFA Rules not processed for user `0b10c80ff2d34af89a80f75254882d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:05.689638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.721810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1007/2016] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:05.721810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.721810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.721810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.741512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:05.744423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.758500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:05.778302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1010/2017] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:05.781818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.844100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1008/2018] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:05.845166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.854883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.870372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e523-2896-4409-9538-ed81b396fe98 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.875463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.875714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.876009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.877502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.877640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb56c-123c-46c2-922c-2cd32e9e8dec None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.877749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.879389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.881988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:05.882963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:05.883512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:05.883826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:05.885001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:05.885309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:05.887249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:05.903404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1011/2019] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:05.904118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.907859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:05.915608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1009/2020] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/projects => generated 405 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:05.916908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:05.970418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e90fd-02eb-46da-a878-64fd0ada4900 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:05.983609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.005284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b5a8-003e-44ee-a9db-351e7a4a6a56 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.010303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.010970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.011248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.011524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.012247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.014145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.027421 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.028097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.028370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.028640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.038229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.039654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.041132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1010/2021] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:05 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:06.041132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.049824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1012/2022] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:06.050662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.060563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3a75-6bda-4dcb-8117-bc4651c5f3fa service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.112851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab65b6-9af0-4019-ab0d-a019bfd077a6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.119856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.120703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.121076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.121682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.122092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.124226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.125211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.126058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.126583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.126711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.127354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.129418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.149143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1011/2023] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:06 2022] POST /identity/v3/users => generated 309 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:06.153438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.156978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1013/2024] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:06 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:06.158162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.164373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e4d83-b03b-4f33-a264-7fbdd149e8e7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.169865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.170537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.170816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.171087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.171251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd7fb-fbb1-4a33-a339-fb0cc4532a6a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.171919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.173523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.176274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.177478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.179372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.179770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.180307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.180927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.183124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.189772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1012/2025] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:06.190602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.202854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1014/2026] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:06.204332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.206458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045e47-e085-403d-b52e-efffb2f52366 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.217433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.217954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.218433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.218868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] PATH_INFO: `/v3/projects/f9c19b36807c44a08c0fa918af3499a8/users/62f0923ba9bb48f39018c7d74cca3eea/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.222988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9613e4-f951-49a4-a279-9c7155043dea admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.228009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.228768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.229101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.229377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.230109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.231874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.236051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c19b36807c44a08c0fa918af3499a8, user_id=62f0923ba9bb48f39018c7d74cca3eea, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.239034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.247433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1015/2027] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:06.248536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.257390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1013/2028] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:06 2022] PUT /identity/v3/projects/f9c19b36807c44a08c0fa918af3499a8/users/62f0923ba9bb48f39018c7d74cca3eea/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:06.258404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.262390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f61fe6-2035-4007-952b-3ac663c1a624 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.328027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4e00-811c-44eb-892d-cc78b29be9cb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.332889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.333591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.333869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.334147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.334972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.337974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.340205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.341129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.341432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.341707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] PATH_INFO: `/v3/projects/47f6fb02f19f49899db23a75ea11f4ae/users/d18a3425a6b946b184ca316e540a50f3/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.351647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1014/2029] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:06.351647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.353507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.362217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f6fb02f19f49899db23a75ea11f4ae, user_id=d18a3425a6b946b184ca316e540a50f3, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.366671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.367127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1be6a-6ad8-4117-914f-dfe23c5429d9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.371745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.372621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.373089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.373264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] PATH_INFO: `/v3/projects/79d5ddc1e14e46f7bfa69a33723f8aa6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.374514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d5ddc1e14e46f7bfa69a33723f8aa6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.376459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.384421 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1016/2030] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:06 2022] PUT /identity/v3/projects/47f6fb02f19f49899db23a75ea11f4ae/users/d18a3425a6b946b184ca316e540a50f3/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:06.385242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.406569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.425804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d5ddc1e14e46f7bfa69a33723f8aa6', 'request_id': 'req-aab50314-eba4-4e61-a8d8-4bd5385191b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.432129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d5ddc1e14e46f7bfa69a33723f8aa6', 'request_id': 'req-aab50314-eba4-4e61-a8d8-4bd5385191b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.437783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d5ddc1e14e46f7bfa69a33723f8aa6', 'request_id': 'req-aab50314-eba4-4e61-a8d8-4bd5385191b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.451338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] The token cache is being invalidate because project 79d5ddc1e14e46f7bfa69a33723f8aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:06.451651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.452302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aab50314-eba4-4e61-a8d8-4bd5385191b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.453925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1015/2031] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:06 2022] DELETE /identity/v3/projects/79d5ddc1e14e46f7bfa69a33723f8aa6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:06.456998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2665b2-cdb6-4c41-83fc-915bb00eb931 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.456998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2665b2-cdb6-4c41-83fc-915bb00eb931 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.456998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2665b2-cdb6-4c41-83fc-915bb00eb931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.459913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c392ee-027d-4afe-8b4e-16321b2a5297 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.483183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4a2665b2-cdb6-4c41-83fc-915bb00eb931 None None] MFA Rules not processed for user `d18a3425a6b946b184ca316e540a50f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:06.484441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4a2665b2-cdb6-4c41-83fc-915bb00eb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.517496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.519065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.519065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.519065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] PATH_INFO: `/v3/projects/f9c19b36807c44a08c0fa918af3499a8/users/62f0923ba9bb48f39018c7d74cca3eea/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.520930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c19b36807c44a08c0fa918af3499a8, user_id=62f0923ba9bb48f39018c7d74cca3eea, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.524362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.527832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.535386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1017/2032] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:06 2022] PUT /identity/v3/projects/f9c19b36807c44a08c0fa918af3499a8/users/62f0923ba9bb48f39018c7d74cca3eea/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:06.536394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.544102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.558197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1016/2033] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:06.559602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.559959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.560715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.588504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] MFA Rules not processed for user `62f0923ba9bb48f39018c7d74cca3eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:06.589721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.623205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d864-b532-496e-a8d8-8d24a0fdd7bb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.628081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.628985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.629258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.629531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] PATH_INFO: `/v3/users/ae3aeba105c544cdab202d4e0ec8ec8b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.630755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3aeba105c544cdab202d4e0ec8ec8b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.632817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.661507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1017/2034] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:06.662606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.664063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.683928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3aeba105c544cdab202d4e0ec8ec8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.684594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3aeba105c544cdab202d4e0ec8ec8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.685204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3aeba105c544cdab202d4e0ec8ec8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.690784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.699735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3aeba105c544cdab202d4e0ec8ec8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.707050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3aeba105c544cdab202d4e0ec8ec8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:06.722005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1018/2035] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:06 2022] DELETE /identity/v3/users/ae3aeba105c544cdab202d4e0ec8ec8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:06.722844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:06.723837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b94212-af3c-4fbc-bd35-c7a188c3649f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.724221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.793584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.794058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.794524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.794885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.796817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa793-89fb-4f9e-877b-c1c610e71795 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:06.797242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.800989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:06.801649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:06.801927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:06.802202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:06.804268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:06.842377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:06.867796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.869346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.879616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1018/2036] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:06.890942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:06.892613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d92de-14a0-4455-94e2-74ffe3dfa8bf service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:06.904623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1019/2037] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:07.002560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.008253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.096666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b2b2-bc66-499f-84df-5f369df22b61 service glance] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.101782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.102860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.103148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.103419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] PATH_INFO: `/v3/projects/46e0837c983448ee9e8bee4d0053aa95` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.105235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e0837c983448ee9e8bee4d0053aa95)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.107646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.162221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e0837c983448ee9e8bee4d0053aa95', 'request_id': 'req-ea77b807-00d5-45eb-809f-75985ceff076'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:07.170016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e0837c983448ee9e8bee4d0053aa95', 'request_id': 'req-ea77b807-00d5-45eb-809f-75985ceff076'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:07.175858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e0837c983448ee9e8bee4d0053aa95', 'request_id': 'req-ea77b807-00d5-45eb-809f-75985ceff076'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:07.190736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] The token cache is being invalidate because project 46e0837c983448ee9e8bee4d0053aa95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:07.191022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:07.191658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ea77b807-00d5-45eb-809f-75985ceff076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:07.193261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1019/2038] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:07 2022] DELETE /identity/v3/projects/46e0837c983448ee9e8bee4d0053aa95 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:07.198567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.198989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.199329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.217080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:07.218283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.282457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1020/2039] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:07.290838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.291277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.291485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.311321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:07.312611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.323244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1020/2040] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:07.327578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.338588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4314ad-33c1-45c5-8937-0b2a49f77a2d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.343549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.344910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.345198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.345477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.346401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:07.346715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.348379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.362923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1021/2041] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:39:07.367672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.377178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac5ab3-b8c9-4caf-b80b-db3e3cafddb3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.382024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.382787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.383137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.383482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.384211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.386298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.418063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1021/2042] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:07.423031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.435499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b15ca-796b-44ab-bacb-ee6744887139 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.441818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:07.501692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.502363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.502663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.502896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.503628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.505544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.528004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1022/2043] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:07.532358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.542891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da7ff-ef78-40de-ad02-5f409c64c10f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.547551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.548311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.548596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.548880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.549620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.551240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.563351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1022/2044] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:07.566888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.568239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.568881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.578420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994b92-b745-4eb9-9b58-6981a2e43047 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.583205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.583889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.584239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.584629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.585354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.586973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.596781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1023/2045] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:07.601098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.610609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbf4a9-18e7-4845-bb81-d709cfe8b786 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.615365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.616433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.616708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.616977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] PATH_INFO: `/v3/projects/634cab889d8547deab6eccc06f86fe23/users/5aacde730e384f1abdef5845124ae403/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.627957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7abf-2980-4955-ae24-21a9c48c3be6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.632566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.632712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634cab889d8547deab6eccc06f86fe23, user_id=5aacde730e384f1abdef5845124ae403, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.633232 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.633514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.633792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.635318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb4d9d-bbba-4f0b-bd1c-8ea0c1c42dc3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.635604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.637564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:07.651316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1024/2046] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:07 2022] PUT /identity/v3/projects/634cab889d8547deab6eccc06f86fe23/users/5aacde730e384f1abdef5845124ae403/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:07.661890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.662177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.662835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.689086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] MFA Rules not processed for user `5aacde730e384f1abdef5845124ae403`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:07.690296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.696527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.698024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.707271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1023/2047] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:07.756874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1025/2048] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:07.761800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.775083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61344f-cd86-43f5-bb7f-4b405356c5e3 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.831498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:07.843995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.844699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.844995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.845251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.845963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.847897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.874503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1024/2049] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:07.878816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:07.889848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46a606-fd7e-439f-a8f0-1b57df5dd9b5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:07.963420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:07.964135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.964415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.964687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.965446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:07.967605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:07.990034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1026/2050] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:07.994283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.013291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fda4e-0ce9-4334-9ae9-0e3d08056cbd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.022724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.023575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.023840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.024110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.025122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.026738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.038322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1025/2051] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:08.043142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.054908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eaf5f-ce7d-448c-9eb2-77f617cdd306 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.061861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.062576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.062871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.063478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.064717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.066593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae12ea-4f74-4ab8-8563-79d075eb03db admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.079630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1027/2052] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:08.085014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.095712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabafb-4778-42f0-aee7-bba2b824f0d8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.101319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.102292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.102618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.102930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] PATH_INFO: `/v3/projects/bab264f67e00448c904ce2e7e96da2e7/users/72a025bbbbc449fabc020d22b4b1dae8/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.118157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab264f67e00448c904ce2e7e96da2e7, user_id=72a025bbbbc449fabc020d22b4b1dae8, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.121283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.138637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1026/2053] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:08 2022] PUT /identity/v3/projects/bab264f67e00448c904ce2e7e96da2e7/users/72a025bbbbc449fabc020d22b4b1dae8/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:08.151068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.151421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.151747 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.188588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] MFA Rules not processed for user `72a025bbbbc449fabc020d22b4b1dae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:08.189826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:08.244146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:08.263039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1028/2054] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:08.267085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.283558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.285585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:08.334997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc32cb-3279-4472-abac-d492e5b2a57f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.339512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.340203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.340487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.340757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.341479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.343401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.345283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ae52-bc28-415e-9ddf-a19b5290e7bc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.348970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.349638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.350004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.350280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.352186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:08.371135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1027/2055] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:08 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:08.375068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.421556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.422927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.433080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1029/2056] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:08.435809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1006c-37dc-45ab-8be0-25e77a1b9ea6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.440420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.441083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.441358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.441628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.442501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.445190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.468450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1028/2057] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:08 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:08.472550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.483634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4c10-03af-4b51-8e75-b13329c28e45 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.488648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.489371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.489657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.489963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.490857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.492535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.506579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1030/2058] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:08.508716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.519234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670b957-692f-49fe-9dfe-c56a53bdf921 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.524416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.525405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.525740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.526081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] PATH_INFO: `/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293/users/0a2ab9d8e28e46cc8894630c905cc270/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.542686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca0ca2310f84d74b008fb2e0f09c293, user_id=0a2ab9d8e28e46cc8894630c905cc270, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.545455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.547761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:08.561474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1029/2059] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:08 2022] PUT /identity/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293/users/0a2ab9d8e28e46cc8894630c905cc270/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:08.565650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.578061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54878-6dd1-4f66-be12-389acf206ef6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.641429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.642094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.642372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.642642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.643373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.645036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f408b-ccbb-4300-9d0c-8d7b48484780 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.655294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1031/2060] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:08.659888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.671452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6fb7f-1632-440d-b354-8f32ff3c2675 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.677355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.678330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.678608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.678880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] PATH_INFO: `/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293/users/0a2ab9d8e28e46cc8894630c905cc270/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.681149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca0ca2310f84d74b008fb2e0f09c293, user_id=0a2ab9d8e28e46cc8894630c905cc270, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.683859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.695153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1030/2061] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:08 2022] PUT /identity/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293/users/0a2ab9d8e28e46cc8894630c905cc270/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:08.705207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.705465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.705735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.732636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] MFA Rules not processed for user `0a2ab9d8e28e46cc8894630c905cc270`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:08.733857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:08.746964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:08.807060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1032/2062] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:08.817871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:08.875586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c239d0-82a7-48ba-9058-e0b2e7b6930c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:08.879432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:08.880085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:08.880362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:08.880634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:08.889820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:08.891260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:08.900908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1031/2063] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:09.454907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:09.465213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cee38-4a83-42c3-83ff-4eec6414dc56 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:09.469415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:09.470048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:09.470489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:09.470828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:09.536274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:09.538174 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5400bc5-39c2-4351-9785-cdd82d97e2ac service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:09.550460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1033/2064] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:18.897016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=2,keystone:SELECT=33 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:19.543756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=50 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:20.486865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:20.488721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:20.560788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bd5de-e49f-4843-81c3-e2a8ddddeaff service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:20.565471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:20.566350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.566622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.566887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] PATH_INFO: `/v3/users/c9d2254c24884aafa36824feb2a95fb4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.568110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d2254c24884aafa36824feb2a95fb4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:20.570079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:20.621273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d2254c24884aafa36824feb2a95fb4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.622036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d2254c24884aafa36824feb2a95fb4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.622640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d2254c24884aafa36824feb2a95fb4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.636488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d2254c24884aafa36824feb2a95fb4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.644023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d2254c24884aafa36824feb2a95fb4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.658687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1032/2065] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:20 2022] DELETE /identity/v3/users/c9d2254c24884aafa36824feb2a95fb4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:20.663369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d948-104b-4e25-b968-85e84383af52 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.663930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d948-104b-4e25-b968-85e84383af52 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.664030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d948-104b-4e25-b968-85e84383af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.682053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a269d948-104b-4e25-b968-85e84383af52 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:20.683268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a269d948-104b-4e25-b968-85e84383af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:20.753105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1034/2066] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:20.761208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:20.762873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:20.855916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269d948-104b-4e25-b968-85e84383af52 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:20.859399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a269d948-104b-4e25-b968-85e84383af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:20.873422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b884d-a1c9-456d-afc1-9bf1e4217c64 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:20.876374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269d948-104b-4e25-b968-85e84383af52 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:20.877297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:20.877978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.878332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.878609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.881542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:20.882629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.882907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.883176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] PATH_INFO: `/v3/users/afa9acd8e92844d7a6db66ccce22299d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.884674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa9acd8e92844d7a6db66ccce22299d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:20.886762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:20.890124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:20.892079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469ce9-7556-4555-aff9-68314ccbf5ac service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:20.903455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1033/2067] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:20.962155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa9acd8e92844d7a6db66ccce22299d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.965947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa9acd8e92844d7a6db66ccce22299d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:20.987661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa9acd8e92844d7a6db66ccce22299d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.004833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa9acd8e92844d7a6db66ccce22299d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.005524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa9acd8e92844d7a6db66ccce22299d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.025332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.025618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.025893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.027729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1035/2068] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:20 2022] DELETE /identity/v3/users/afa9acd8e92844d7a6db66ccce22299d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:21.052160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:21.053516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.057868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.059599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.088096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.132261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1034/2069] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:21.141951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.143697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.152700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b43b-60a6-43ee-9d20-310dc9731750 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.157162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.157815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.158092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.158376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.160254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.191349 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.226667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa792f-8a93-4405-97d4-d81449318dfa None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.230627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.231367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.231740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.232082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.245091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.249116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.249266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.250710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.258231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1035/2070] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:21.259310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.260953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.263468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1036/2071] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:21.322410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4efcd-a1f2-4ac9-9929-73550c345e58 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.330324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.331854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.332297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.332713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] PATH_INFO: `/v3/projects/ebeac679b5e341f4bd5781e021234969` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.334691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebeac679b5e341f4bd5781e021234969)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.337396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.413798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebeac679b5e341f4bd5781e021234969', 'request_id': 'req-7128498e-d66a-4cde-9e73-5c9f03a9219a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.421011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.422496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.422720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebeac679b5e341f4bd5781e021234969', 'request_id': 'req-7128498e-d66a-4cde-9e73-5c9f03a9219a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.430338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebeac679b5e341f4bd5781e021234969', 'request_id': 'req-7128498e-d66a-4cde-9e73-5c9f03a9219a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.449041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9cb7-c827-4da5-83b6-e8beedfe8f5d service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.475871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] The token cache is being invalidate because project ebeac679b5e341f4bd5781e021234969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:21.476521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.477520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.480759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1036/2072] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:21 2022] DELETE /identity/v3/projects/ebeac679b5e341f4bd5781e021234969 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:21.485483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.488365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.563053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.564019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.564307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.564585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] PATH_INFO: `/v3/users/0b10c80ff2d34af89a80f75254882d93` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.565809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b10c80ff2d34af89a80f75254882d93)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.567791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.569281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.616480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128498e-d66a-4cde-9e73-5c9f03a9219a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.622677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.623597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.623922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.624201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] PATH_INFO: `/v3/users/f98e3c5a3a584c65ad20a9bc629bde31` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.625797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98e3c5a3a584c65ad20a9bc629bde31)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.628125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.632633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b10c80ff2d34af89a80f75254882d93'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.633505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b10c80ff2d34af89a80f75254882d93'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.643855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b10c80ff2d34af89a80f75254882d93'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.658888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b10c80ff2d34af89a80f75254882d93'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.659984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b10c80ff2d34af89a80f75254882d93'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.677375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1037/2073] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:21 2022] DELETE /identity/v3/users/0b10c80ff2d34af89a80f75254882d93 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:21.678422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.682863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.713847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98e3c5a3a584c65ad20a9bc629bde31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.714931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98e3c5a3a584c65ad20a9bc629bde31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.715572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98e3c5a3a584c65ad20a9bc629bde31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.732112 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98e3c5a3a584c65ad20a9bc629bde31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.742449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c4ca38b7-73c2-49c8-af97-ab8b0ab05cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98e3c5a3a584c65ad20a9bc629bde31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:21.761156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.768599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1037/2074] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:21 2022] DELETE /identity/v3/users/f98e3c5a3a584c65ad20a9bc629bde31 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:21.773799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.774091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.775224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.800974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6017f-d1b4-4d46-b8c6-32711aff0b58 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.801535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:21.802812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.915914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.916880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.917226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.918598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] PATH_INFO: `/v3/projects/ea9377f9467a47638ac2a43a11b51d6a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.920008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9377f9467a47638ac2a43a11b51d6a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.920452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1038/2075] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:21.922465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.971940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.974422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.033564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9377f9467a47638ac2a43a11b51d6a', 'request_id': 'req-9dc60421-f0e8-4712-8d90-483c86b45bde'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.063805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9377f9467a47638ac2a43a11b51d6a', 'request_id': 'req-9dc60421-f0e8-4712-8d90-483c86b45bde'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.080033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9377f9467a47638ac2a43a11b51d6a', 'request_id': 'req-9dc60421-f0e8-4712-8d90-483c86b45bde'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.108831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eef5f9-4e31-4e94-8f78-fa731340a171 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.126870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] The token cache is being invalidate because project ea9377f9467a47638ac2a43a11b51d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:22.126870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.128989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.144703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1038/2076] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:21 2022] DELETE /identity/v3/projects/ea9377f9467a47638ac2a43a11b51d6a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:22.149010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:22.150532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.152212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.184315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.185787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.186068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.186345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.188249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.276345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.277828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.290140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1039/2077] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:22.323558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60421-f0e8-4712-8d90-483c86b45bde admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.350354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.351874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.352878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.353383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] PATH_INFO: `/v3/users/302b0408a0444d1cabd9e4df9264c0c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.355200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=302b0408a0444d1cabd9e4df9264c0c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.357537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.380362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.382373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.411447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2716ea-686c-4425-9db1-aebadc6e98a3 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.424330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.425249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.425524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.425849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] PATH_INFO: `/v3/projects/cbfd7e746a1d4459b16336059be2f416` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.430662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfd7e746a1d4459b16336059be2f416)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.431932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:22.432710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.460343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302b0408a0444d1cabd9e4df9264c0c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.462172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302b0408a0444d1cabd9e4df9264c0c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.470187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302b0408a0444d1cabd9e4df9264c0c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.486380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302b0408a0444d1cabd9e4df9264c0c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.487377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-37c39fe0-f904-40f2-8d1c-1a2823d8f23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302b0408a0444d1cabd9e4df9264c0c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.514854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1039/2078] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:22 2022] DELETE /identity/v3/users/302b0408a0444d1cabd9e4df9264c0c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:22.515506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfd7e746a1d4459b16336059be2f416', 'request_id': 'req-ab676206-d3df-480f-9644-df7f244b1639'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.544282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfd7e746a1d4459b16336059be2f416', 'request_id': 'req-ab676206-d3df-480f-9644-df7f244b1639'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.552469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfd7e746a1d4459b16336059be2f416', 'request_id': 'req-ab676206-d3df-480f-9644-df7f244b1639'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.572221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] The token cache is being invalidate because project cbfd7e746a1d4459b16336059be2f416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:22.572970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.574006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab676206-d3df-480f-9644-df7f244b1639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:22.578010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1040/2079] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:22 2022] DELETE /identity/v3/projects/cbfd7e746a1d4459b16336059be2f416 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:22.584720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.585385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.587398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.630976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:22.632371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.705633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1040/2080] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:22.714500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.716963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.717255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.748383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:22.750080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.764235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1041/2081] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:22.765539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.775865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d5b82-a911-4600-8519-c1a43abf0500 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.780755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.781494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.781719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.781992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.787620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:22.787620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.787620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.808274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1041/2082] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:22.809108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.818944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306540-00d3-4164-b5f0-406c677d6234 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.824801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.825495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.825777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.826048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.827029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.828926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.859996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1042/2083] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:22.864472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.874522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.876649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.876817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6b5b4-d363-4ad2-9e3c-79d3bcb39077 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.916803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:22.953215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.953894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.954240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.954524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.955230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.955528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841334-f5d6-464b-aa15-6b21b97e0b7d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.957322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.960496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.961586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.961958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.962303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] PATH_INFO: `/v3/projects/07bbd36bd9654c439eb0e5470f389ddd` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.963645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bbd36bd9654c439eb0e5470f389ddd)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.965895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.979214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1042/2084] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:22.983339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.005122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613da1-53c1-4f01-91f6-93c76120ea77 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.010395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.010764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.011196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.011320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.012130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.013799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.022389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bbd36bd9654c439eb0e5470f389ddd', 'request_id': 'req-51895472-ea6e-4ae8-924d-49d48ccb7baa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.025887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1043/2085] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:39:23.029570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.032481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bbd36bd9654c439eb0e5470f389ddd', 'request_id': 'req-51895472-ea6e-4ae8-924d-49d48ccb7baa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.038923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bbd36bd9654c439eb0e5470f389ddd', 'request_id': 'req-51895472-ea6e-4ae8-924d-49d48ccb7baa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.041344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b0f77-c300-4fb6-9df5-f1aee85ad424 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.053164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] The token cache is being invalidate because project 07bbd36bd9654c439eb0e5470f389ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:23.053407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:23.053501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.054115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.056386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1043/2086] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:22 2022] DELETE /identity/v3/projects/07bbd36bd9654c439eb0e5470f389ddd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:23.061071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.065383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.137404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.138203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.138602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.138878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.139663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.141466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.157031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1044/2087] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:23.157031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.158215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.172919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51895472-ea6e-4ae8-924d-49d48ccb7baa admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.173142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af85a1-b3da-41f3-967e-b716d29f0405 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.177045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.177213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.178310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.178465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.178603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.178738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.179006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] PATH_INFO: `/v3/users/d3ed0704f24c4cf895b4d7ca82f1f700` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.179112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] PATH_INFO: `/v3/projects/f2577303518d4626b1d7a91dd5790248` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.180388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2577303518d4626b1d7a91dd5790248)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.181497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ed0704f24c4cf895b4d7ca82f1f700)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.183420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.183585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.250614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ed0704f24c4cf895b4d7ca82f1f700'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.251363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ed0704f24c4cf895b4d7ca82f1f700'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.251525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2577303518d4626b1d7a91dd5790248', 'request_id': 'req-73f55ae0-dc36-4184-9b4f-618afe1ceac9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.252300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ed0704f24c4cf895b4d7ca82f1f700'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.259395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2577303518d4626b1d7a91dd5790248', 'request_id': 'req-73f55ae0-dc36-4184-9b4f-618afe1ceac9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.265860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2577303518d4626b1d7a91dd5790248', 'request_id': 'req-73f55ae0-dc36-4184-9b4f-618afe1ceac9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.266779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:23.269709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ed0704f24c4cf895b4d7ca82f1f700'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.281510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ed0704f24c4cf895b4d7ca82f1f700'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.287426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] The token cache is being invalidate because project f2577303518d4626b1d7a91dd5790248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:23.287658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.288430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.290091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1045/2088] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:23 2022] DELETE /identity/v3/projects/f2577303518d4626b1d7a91dd5790248 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:23.293125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.294442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.306559 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1044/2089] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:23 2022] DELETE /identity/v3/users/d3ed0704f24c4cf895b4d7ca82f1f700 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:23.307347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.308770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.395620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55ae0-dc36-4184-9b4f-618afe1ceac9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.400932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba423ab-705f-4070-8ac1-363c1dbbc56c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.415327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.416354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.416955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.420046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] PATH_INFO: `/v3/projects/8438862f29d44496b453fcf377363408/users/5509698669d242f2b0e972bd8531aa99/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.426102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.427012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.427563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.427740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] PATH_INFO: `/v3/users/62f0923ba9bb48f39018c7d74cca3eea` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.432660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f0923ba9bb48f39018c7d74cca3eea)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.434788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.445131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8438862f29d44496b453fcf377363408, user_id=5509698669d242f2b0e972bd8531aa99, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.451520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d949a0-1eaa-4e9b-9b7b-763376684b9b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.480963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1046/2090] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:23 2022] PUT /identity/v3/projects/8438862f29d44496b453fcf377363408/users/5509698669d242f2b0e972bd8531aa99/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:23.492107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.492460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.492663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.526613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f0923ba9bb48f39018c7d74cca3eea'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.527501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f0923ba9bb48f39018c7d74cca3eea'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.528297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f0923ba9bb48f39018c7d74cca3eea'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.531643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:23.564109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] MFA Rules not processed for user `5509698669d242f2b0e972bd8531aa99`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:23.568042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.571335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f0923ba9bb48f39018c7d74cca3eea'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.587471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f0923ba9bb48f39018c7d74cca3eea'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.629392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1045/2091] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:23 2022] DELETE /identity/v3/users/62f0923ba9bb48f39018c7d74cca3eea => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:23.736687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1047/2092] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:23.741197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.743116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.756941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.760716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.859161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:23.864880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac06e-91c9-43fb-9d69-f3c4f2db61b9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.874915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.875666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.875978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.876277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.877140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.879472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.898673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe899a92-75fc-4103-a55b-0684f0a30946 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.905755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.906643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.906931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.907188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] PATH_INFO: `/v3/projects/7758d2457ca6438f95a4625017aecb25` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.909020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7758d2457ca6438f95a4625017aecb25)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.911367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.934533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1046/2093] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:23 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:23.938214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.974802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7758d2457ca6438f95a4625017aecb25', 'request_id': 'req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:23.984357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7758d2457ca6438f95a4625017aecb25', 'request_id': 'req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.007338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7758d2457ca6438f95a4625017aecb25', 'request_id': 'req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.035884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b982dd-875d-400b-9ea7-fed9f75486bf admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.036611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] The token cache is being invalidate because project 7758d2457ca6438f95a4625017aecb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:24.037082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.038255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ef9db2c6-2cad-4a8a-ae68-716e0fcf5b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.041425 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1048/2094] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:23 2022] DELETE /identity/v3/projects/7758d2457ca6438f95a4625017aecb25 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:24.048855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.048855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.048855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.079578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:24.084097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.135943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:24.142497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.143140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.143554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.143840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.144547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.147687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.175010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1047/2095] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:23 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:24.175010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.176302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.187734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1049/2096] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:24.188869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.192641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a8258-f91a-4a74-b1b9-644291c5a33b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.197448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.200021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.200904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.201186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.201459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] PATH_INFO: `/v3/projects/f9c19b36807c44a08c0fa918af3499a8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.202641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c19b36807c44a08c0fa918af3499a8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.204779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.209481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0ed8-e80e-4fec-a508-a6afbdd5d7c2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.215467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.216577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.216945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.217254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] PATH_INFO: `/v3/users/5aacde730e384f1abdef5845124ae403` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.219087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aacde730e384f1abdef5845124ae403)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.221171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.261111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c19b36807c44a08c0fa918af3499a8', 'request_id': 'req-12ad0d15-fd05-41e3-902b-7daf169cecc3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.269231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c19b36807c44a08c0fa918af3499a8', 'request_id': 'req-12ad0d15-fd05-41e3-902b-7daf169cecc3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.278286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c19b36807c44a08c0fa918af3499a8', 'request_id': 'req-12ad0d15-fd05-41e3-902b-7daf169cecc3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.285183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aacde730e384f1abdef5845124ae403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.288239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aacde730e384f1abdef5845124ae403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.297214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aacde730e384f1abdef5845124ae403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.298490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] The token cache is being invalidate because project f9c19b36807c44a08c0fa918af3499a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:24.299013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.299711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.301573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1048/2097] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:24 2022] DELETE /identity/v3/projects/f9c19b36807c44a08c0fa918af3499a8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:24.304922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.306997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.314612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aacde730e384f1abdef5845124ae403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.315354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f752c120-42a9-45c5-9183-7f4c41427873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aacde730e384f1abdef5845124ae403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:24.320768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:24.331920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1050/2098] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:24 2022] DELETE /identity/v3/users/5aacde730e384f1abdef5845124ae403 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:24.333080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ca9b-c465-472f-9c7f-aa5755ffa630 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.333397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ca9b-c465-472f-9c7f-aa5755ffa630 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.333652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ca9b-c465-472f-9c7f-aa5755ffa630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.355634 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c471ca9b-c465-472f-9c7f-aa5755ffa630 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:24.356860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c471ca9b-c465-472f-9c7f-aa5755ffa630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.392382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0d15-fd05-41e3-902b-7daf169cecc3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.439250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1051/2099] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:24.441106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983735-3989-477d-b417-a18733a50f77 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.441396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983735-3989-477d-b417-a18733a50f77 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.442105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983735-3989-477d-b417-a18733a50f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.468939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-11983735-3989-477d-b417-a18733a50f77 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:24.476360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.478988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.479397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.480154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.481183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.483192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cf24b-5117-476b-b2f2-fabe93d6b793 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.490738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-11983735-3989-477d-b417-a18733a50f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.497402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1049/2100] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:24.499212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.499762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.500244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.508128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1052/2101] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:24.509867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983735-3989-477d-b417-a18733a50f77 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.529902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983735-3989-477d-b417-a18733a50f77 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.531663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:24.532981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.535516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.536369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.536588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.536955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.537704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:24.538012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.539953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf888-5a10-4b19-8383-04e06adbeb68 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.542087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1050/2102] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:24.542914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.553560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94444453-1bae-4dd9-af51-f31a77f68e32 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.559322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.560305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.560593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.560869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] PATH_INFO: `/v3/projects/feb279486da245949103f0777ef049f0/users/027b7c0fc733485d9ab6fd17037e8200/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.562945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1053/2103] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:24.564477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.564956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.565404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.588213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:24.589036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb279486da245949103f0777ef049f0, user_id=027b7c0fc733485d9ab6fd17037e8200, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.591725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.592338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.600638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1054/2104] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:24.600638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.600638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:24.610927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1051/2105] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:24 2022] PUT /identity/v3/projects/feb279486da245949103f0777ef049f0/users/027b7c0fc733485d9ab6fd17037e8200/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:24.611740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.633036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:24.705054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedde2c-8100-4bc0-8af0-61b0b2171b53 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.710155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a163-3eb8-4db6-ae7e-c9b53de3a3d4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.715285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.716116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.716405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.716677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.717377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.728614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.754303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:24.756776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.757439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.757723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.757979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.763979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1052/2106] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:24.767960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.768583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.770032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.780802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1055/2107] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:24.781883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.799198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3984d5-0c62-4af8-85bd-da416cb095c8 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.870535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a44cd-f401-4223-8d3c-b44b421ebf63 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.876750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.877613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.878011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.878478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.879309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:24.879650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.881284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.887344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.888056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.888338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.888608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.889340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.890948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.899837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1053/2108] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:24.900957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.904311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1056/2109] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:24.905087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.914450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410b96-1f7e-48f0-8a28-6fdb35d33686 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.917301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472363bc-e0a7-4889-b046-fe65fe84795f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.919114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.919822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.920106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.920622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.921071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.923317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.925616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.928484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.929018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.929553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.930911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.933616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.958987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1054/2110] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/users => generated 286 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:24.958987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.970033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4779d-d957-4135-84a8-81df59e05d47 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:24.973443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1057/2111] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:24.974013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:24.976356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:24.977289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:24.977681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:24.977859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] PATH_INFO: `/v3/projects/feb279486da245949103f0777ef049f0/users/027b7c0fc733485d9ab6fd17037e8200/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:24.980351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb279486da245949103f0777ef049f0, user_id=027b7c0fc733485d9ab6fd17037e8200, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:24.983328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:24.997752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1055/2112] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:24 2022] PUT /identity/v3/projects/feb279486da245949103f0777ef049f0/users/027b7c0fc733485d9ab6fd17037e8200/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:24.998684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.040783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:25.055735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb7280-ca03-47c0-b6e4-7d74f48c3e28 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.074115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd113fe-c082-4185-893f-acb0bbbe11ac admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.079166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.079949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.080297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.080639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.081391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.083419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a14dc-6af5-4e1a-952a-58baf01b8d87 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.117136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1056/2113] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:24 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:25.118984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.119615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.119881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.133383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.134450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.134657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.134945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.135785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.139630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.153730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1058/2114] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:25.154936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.173853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] MFA Rules not processed for user `027b7c0fc733485d9ab6fd17037e8200`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:25.174501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f25953-eefc-4a4f-b59c-66a7369960b2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.175061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.179435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.179885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.180168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.180826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.181942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.183728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.194834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1059/2115] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:25.195774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.199770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.213181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be298-1718-47e9-a0d0-f7bc2a0d23f1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.217954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.218851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.219128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.219401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] PATH_INFO: `/v3/projects/634cab889d8547deab6eccc06f86fe23` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.220676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=634cab889d8547deab6eccc06f86fe23)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.221050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:25.222652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.252114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1057/2116] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:25.255848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.269037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f861d-d84e-4e3a-a762-36c203bcf370 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.278012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634cab889d8547deab6eccc06f86fe23', 'request_id': 'req-07a0ea78-a122-4e53-8534-fdc9212c16dd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.285998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634cab889d8547deab6eccc06f86fe23', 'request_id': 'req-07a0ea78-a122-4e53-8534-fdc9212c16dd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.292285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634cab889d8547deab6eccc06f86fe23', 'request_id': 'req-07a0ea78-a122-4e53-8534-fdc9212c16dd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.306737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] The token cache is being invalidate because project 634cab889d8547deab6eccc06f86fe23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:25.307027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.307723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.309659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1060/2117] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:25 2022] DELETE /identity/v3/projects/634cab889d8547deab6eccc06f86fe23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:25.310252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.311723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.330398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.331386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.331858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.332288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.333037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.334783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.345707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1058/2118] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:25.346550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.348503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.381416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ea78-a122-4e53-8534-fdc9212c16dd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.387052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.387788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.388074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.388347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.389084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.390711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.403516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1061/2119] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:25.407518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.409386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.409973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ed71-6306-431a-9c82-1964180a4b9d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.413574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.414216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.414614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.414968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.417028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.417460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:25.422548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3566a-4216-4973-b0a2-683bdb63af27 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.428095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.428976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.429321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.429598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] PATH_INFO: `/v3/users/72a025bbbbc449fabc020d22b4b1dae8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.430860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a025bbbbc449fabc020d22b4b1dae8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.432897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.483766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a025bbbbc449fabc020d22b4b1dae8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.484444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a025bbbbc449fabc020d22b4b1dae8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.490442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.491976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.492200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a025bbbbc449fabc020d22b4b1dae8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.502785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1059/2120] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:25.503628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.504825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a025bbbbc449fabc020d22b4b1dae8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.504944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.505762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a025bbbbc449fabc020d22b4b1dae8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:25.523523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dface-1faa-41c1-b13f-a0f8cd751811 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.528627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1062/2121] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:25 2022] DELETE /identity/v3/users/72a025bbbbc449fabc020d22b4b1dae8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:25.529736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.530702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.530986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.531218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.531330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] PATH_INFO: `/v3/projects/33f63d300d1a4d1a8aeae3eddefd6058/users/8842101b4b2a42e09c31199e6dbbe018/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.533714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.551530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f63d300d1a4d1a8aeae3eddefd6058, user_id=8842101b4b2a42e09c31199e6dbbe018, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.555757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2686b-8a90-4eb7-825e-18ca38a2fce5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.576491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:25.605927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1060/2122] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:25 2022] PUT /identity/v3/projects/33f63d300d1a4d1a8aeae3eddefd6058/users/8842101b4b2a42e09c31199e6dbbe018/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:25.607836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.608510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.608785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.629856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1eeed8-a4c1-4460-b283-98e377f2326f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.661054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] MFA Rules not processed for user `8842101b4b2a42e09c31199e6dbbe018`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:25.662734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.753801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.756686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.756978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.758627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] PATH_INFO: `/v3/projects/f3e65c4161a24a3e93b9c2e4c35e3800/users/4eefe9661863485fa71d18bbd6351852/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.761035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1061/2123] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:25.789686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.791825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.802527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e65c4161a24a3e93b9c2e4c35e3800, user_id=4eefe9661863485fa71d18bbd6351852, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.805486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4759dba-fa48-4b7a-aef6-b69adf365690 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.832974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1063/2124] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:25 2022] PUT /identity/v3/projects/f3e65c4161a24a3e93b9c2e4c35e3800/users/4eefe9661863485fa71d18bbd6351852/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:25.841950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.842391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.842763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.852243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:25.895711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] MFA Rules not processed for user `4eefe9661863485fa71d18bbd6351852`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:25.897372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.908413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e579d9-d97f-43e7-baf7-ba0371fbab49 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.990132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.991813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.992275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.992552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.014203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1064/2125] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:26.022957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.092919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.094729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.101346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:26.108053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1062/2126] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:26.126347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.130331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.159085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1dee-3702-47a4-828a-8fd391a128f9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.164151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ea2f-35f2-46b2-9e18-b4d7767a7b85 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.165465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.166662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.167054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.167596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.168433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.169703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.170635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.170932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.171024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.171353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] PATH_INFO: `/v3/projects/bab264f67e00448c904ce2e7e96da2e7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.172634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab264f67e00448c904ce2e7e96da2e7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.174851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.204417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1065/2127] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:26.205380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.208007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.245840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab264f67e00448c904ce2e7e96da2e7', 'request_id': 'req-19ca66d7-dc15-471f-b130-bccb44c110a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.252838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab264f67e00448c904ce2e7e96da2e7', 'request_id': 'req-19ca66d7-dc15-471f-b130-bccb44c110a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.261952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab264f67e00448c904ce2e7e96da2e7', 'request_id': 'req-19ca66d7-dc15-471f-b130-bccb44c110a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.279796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] The token cache is being invalidate because project bab264f67e00448c904ce2e7e96da2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:26.279947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786d6c-c8ac-404a-b37a-b09c3ebf8109 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.280277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.281072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.285775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1063/2128] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:26 2022] DELETE /identity/v3/projects/bab264f67e00448c904ce2e7e96da2e7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:26.285775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.285775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.313411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:26.360932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.361810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.362083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.362403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] PATH_INFO: `/v3/users/5509698669d242f2b0e972bd8531aa99` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.363873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5509698669d242f2b0e972bd8531aa99)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.366790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.368180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca66d7-dc15-471f-b130-bccb44c110a5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.373704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.374699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.375044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.375386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] PATH_INFO: `/v3/users/8842101b4b2a42e09c31199e6dbbe018` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.376944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8842101b4b2a42e09c31199e6dbbe018)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.378999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.425608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5509698669d242f2b0e972bd8531aa99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.426294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5509698669d242f2b0e972bd8531aa99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.434004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8842101b4b2a42e09c31199e6dbbe018'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.434578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8842101b4b2a42e09c31199e6dbbe018'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.436472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8842101b4b2a42e09c31199e6dbbe018'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.437455 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5509698669d242f2b0e972bd8531aa99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.450692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8842101b4b2a42e09c31199e6dbbe018'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.453136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5509698669d242f2b0e972bd8531aa99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.453956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5509698669d242f2b0e972bd8531aa99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.458344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8842101b4b2a42e09c31199e6dbbe018'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.470279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1066/2129] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:26 2022] DELETE /identity/v3/users/5509698669d242f2b0e972bd8531aa99 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:26.471559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.473092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1064/2130] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:26 2022] DELETE /identity/v3/users/8842101b4b2a42e09c31199e6dbbe018 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:26.474266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.475735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.477953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.481129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:26.553155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6032-4122-44e7-baf1-e365b3046d1b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.553797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751554-1998-4806-aa78-8e7feb479cfc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.558259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.558674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.559290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.559410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.559673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.559776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.559947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.560143 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] PATH_INFO: `/v3/users/0a2ab9d8e28e46cc8894630c905cc270` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.560645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.561447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2ab9d8e28e46cc8894630c905cc270)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.562611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f423-bcde-4aac-a81a-55238f4ee0c8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.563573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.595573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1067/2131] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:26.595573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eafc5-59cc-49c4-994c-c666a2e5a4f4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.595573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eafc5-59cc-49c4-994c-c666a2e5a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.595930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eafc5-59cc-49c4-994c-c666a2e5a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.616854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3c5eafc5-59cc-49c4-994c-c666a2e5a4f4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.618099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3c5eafc5-59cc-49c4-994c-c666a2e5a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.625423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2ab9d8e28e46cc8894630c905cc270'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.626183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2ab9d8e28e46cc8894630c905cc270'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.626287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1068/2132] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:26.627586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.627864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.628141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.630105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2ab9d8e28e46cc8894630c905cc270'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.646927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2ab9d8e28e46cc8894630c905cc270'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.649275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.650537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.654844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2ab9d8e28e46cc8894630c905cc270'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:26.658812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1069/2133] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:26.662167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.662167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.670739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1065/2134] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:26 2022] DELETE /identity/v3/users/0a2ab9d8e28e46cc8894630c905cc270 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:26.671800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.673995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.674713 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e35c6-2aa0-4fc6-ac43-d2780de1eac4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.697744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:26.742958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.744008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.744236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.744521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.745486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.747234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.761981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb30-58e6-4d52-9bfd-b1129e286f4c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.762405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1070/2135] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:26.763272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.773017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.773017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.773017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.773017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.774062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80edcd-23b8-4339-8689-fe3da840dcb6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.778802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.781382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.781382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.781382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.782242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.806557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.808954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.812584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.814064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6dead-908a-4190-9921-547dcf63c3c0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.825791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1066/2136] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:26.826838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.840658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1071/2137] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:26.843845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef4a-acce-4303-a95a-d4a3d3ea10c3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.845423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef4a-acce-4303-a95a-d4a3d3ea10c3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.845562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0aa67-c721-4108-9158-a2f2ddd992ae service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.845726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef4a-acce-4303-a95a-d4a3d3ea10c3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.849363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1072/2138] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:39:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:26.851086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.852719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.853092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.853457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] PATH_INFO: `/v3/projects/062dbe8e60f04024ba789160e0e093a3/users/b25150d52091440884087e9d6b74fa3d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.884597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=062dbe8e60f04024ba789160e0e093a3, user_id=b25150d52091440884087e9d6b74fa3d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.886635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.897019 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aaf4-0e82-4502-a806-112571303afa None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.897389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aaf4-0e82-4502-a806-112571303afa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.897772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aaf4-0e82-4502-a806-112571303afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.900760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:26.911155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1067/2139] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:26 2022] PUT /identity/v3/projects/062dbe8e60f04024ba789160e0e093a3/users/b25150d52091440884087e9d6b74fa3d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:26.916447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.932753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7989aaf4-0e82-4502-a806-112571303afa None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.934188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7989aaf4-0e82-4502-a806-112571303afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.028888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1073/2140] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:27.029737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989aaf4-0e82-4502-a806-112571303afa None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.031364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7989aaf4-0e82-4502-a806-112571303afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.037450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9acb-6fb9-42c8-b3a0-af4e0deec77e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.044863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.045869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.046493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.046833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.047678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.048307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989aaf4-0e82-4502-a806-112571303afa None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.049706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.054314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.055563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.055817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.056215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] PATH_INFO: `/v3/users/5d19942e971b4d7fac3ab8f9a5ad6086` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.058123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d19942e971b4d7fac3ab8f9a5ad6086)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.060944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.064472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1068/2141] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:39:27.066083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.071120 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.092923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc78-04f5-40c8-8898-bb10df6ad5fc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.101541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.102794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.104247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.105668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.120794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.123853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.145115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1069/2142] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:27.146968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.150348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d19942e971b4d7fac3ab8f9a5ad6086'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.152146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d19942e971b4d7fac3ab8f9a5ad6086'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.165471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40d8b-f5c8-4158-ae1b-8a23abc514e8 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.180150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d19942e971b4d7fac3ab8f9a5ad6086'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.208629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.209434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.209772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.210007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] PATH_INFO: `/v3/projects/062dbe8e60f04024ba789160e0e093a3/users/b25150d52091440884087e9d6b74fa3d/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.212544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062dbe8e60f04024ba789160e0e093a3, user_id=b25150d52091440884087e9d6b74fa3d, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.215668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.221658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d19942e971b4d7fac3ab8f9a5ad6086'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.221658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-afc789ac-b11f-464e-8741-e1fd18f98334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d19942e971b4d7fac3ab8f9a5ad6086'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.230450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1070/2143] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:27 2022] PUT /identity/v3/projects/062dbe8e60f04024ba789160e0e093a3/users/b25150d52091440884087e9d6b74fa3d/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:27.240224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1074/2144] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:27 2022] DELETE /identity/v3/users/5d19942e971b4d7fac3ab8f9a5ad6086 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:27.240350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.241845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.242487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.244288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.244550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.300299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.306020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] MFA Rules not processed for user `b25150d52091440884087e9d6b74fa3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:27.308617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.333347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b71b-728d-406f-9ad8-1c86dcb84963 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.402381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1075/2145] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:27.415201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.417048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.420268 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.420846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.421250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.421532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] PATH_INFO: `/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.422881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca0ca2310f84d74b008fb2e0f09c293)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.425812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.460598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.507055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca0ca2310f84d74b008fb2e0f09c293', 'request_id': 'req-89968a55-e2b8-4172-a704-bb03291cb0a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.517231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca0ca2310f84d74b008fb2e0f09c293', 'request_id': 'req-89968a55-e2b8-4172-a704-bb03291cb0a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.525187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a16c8-665f-4824-83d5-bd0dc276cc7e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.545435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca0ca2310f84d74b008fb2e0f09c293', 'request_id': 'req-89968a55-e2b8-4172-a704-bb03291cb0a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.568651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] The token cache is being invalidate because project 9ca0ca2310f84d74b008fb2e0f09c293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:27.569953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.582083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.584452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1071/2146] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:27 2022] DELETE /identity/v3/projects/9ca0ca2310f84d74b008fb2e0f09c293 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:27.606798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.611929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.614034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.614833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.615124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.615404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.618339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.688997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968a55-e2b8-4172-a704-bb03291cb0a5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.693996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.694968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.695377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.695467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.695879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] PATH_INFO: `/v3/projects/f0f340fa7ff24ca899b0f1036d0e6a3b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.697233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f340fa7ff24ca899b0f1036d0e6a3b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.697356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9314a9-7e78-48dc-9db0-7806050acc0c service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.699453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.707482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1076/2147] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:27.708787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.709069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.709338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.717061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.731008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:27.733059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.742474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1077/2148] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:27.743335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.750510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.768569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'request_id': 'req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.773040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21343f96-c72c-40ae-a219-74690881d0a5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.780802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'request_id': 'req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.788947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'request_id': 'req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.806067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] The token cache is being invalidate because project f0f340fa7ff24ca899b0f1036d0e6a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:27.806415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.807351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.812114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1072/2149] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:27 2022] DELETE /identity/v3/projects/f0f340fa7ff24ca899b0f1036d0e6a3b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:27.812887 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.816599 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.841411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.842289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.842572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.842851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] PATH_INFO: `/v3/projects/33f63d300d1a4d1a8aeae3eddefd6058` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.844066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f63d300d1a4d1a8aeae3eddefd6058)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.846017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.859484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.894917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50a7be-5e40-4b1c-a05f-8f7f80898b82 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.910523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f63d300d1a4d1a8aeae3eddefd6058', 'request_id': 'req-5407e290-a731-4992-b8c4-66c1fd9bcc7c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.917260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f63d300d1a4d1a8aeae3eddefd6058', 'request_id': 'req-5407e290-a731-4992-b8c4-66c1fd9bcc7c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.923641 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f63d300d1a4d1a8aeae3eddefd6058', 'request_id': 'req-5407e290-a731-4992-b8c4-66c1fd9bcc7c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.937292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] The token cache is being invalidate because project 33f63d300d1a4d1a8aeae3eddefd6058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:27.937662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.938359 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5407e290-a731-4992-b8c4-66c1fd9bcc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:27.940172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1078/2150] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:27 2022] DELETE /identity/v3/projects/33f63d300d1a4d1a8aeae3eddefd6058 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:27.941393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.941682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.941953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.960603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:27.961857 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.963453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.964524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.964967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.965317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] PATH_INFO: `/v3/projects/8438862f29d44496b453fcf377363408` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.966808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8438862f29d44496b453fcf377363408)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.969230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.976125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1079/2151] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:27.977152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.978538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.016891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8438862f29d44496b453fcf377363408', 'request_id': 'req-e5685c07-f23a-4387-a4c1-9588734c205a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.023122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8438862f29d44496b453fcf377363408', 'request_id': 'req-e5685c07-f23a-4387-a4c1-9588734c205a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.028979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8438862f29d44496b453fcf377363408', 'request_id': 'req-e5685c07-f23a-4387-a4c1-9588734c205a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.035380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a874bf0-53df-446a-85de-5d3afbc03035 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.043466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] The token cache is being invalidate because project 8438862f29d44496b453fcf377363408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:28.043799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.044420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5685c07-f23a-4387-a4c1-9588734c205a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.045995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1073/2152] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:27 2022] DELETE /identity/v3/projects/8438862f29d44496b453fcf377363408 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:28.049017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64c7d0-7692-46fa-834b-2b15ce6004da None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.049017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64c7d0-7692-46fa-834b-2b15ce6004da None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.049017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64c7d0-7692-46fa-834b-2b15ce6004da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.065955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7f64c7d0-7692-46fa-834b-2b15ce6004da None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:28.067156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7f64c7d0-7692-46fa-834b-2b15ce6004da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.072411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:28.092335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.093003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.093285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.093559 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.095446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.130281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1074/2153] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:28.131657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.132048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.132437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.151333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:28.152569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.156858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.158446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.160632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1075/2154] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:28.161405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.162800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.168214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1080/2155] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:28.169270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.173583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.176283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebfd9e-9668-4128-ad6f-cb1a2dc594d8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.183203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.183203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.183773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.184162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.185017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:28.185425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.187633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229a1d-0728-4327-afe1-459a9f09f205 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.190379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:28.191016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393739cd-a1b5-4bb8-a9a7-659f3183ed28 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.196742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.198292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.198591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.198893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] PATH_INFO: `/v3/users/027b7c0fc733485d9ab6fd17037e8200` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.200484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] RBAC: Authorizing `identity:delete_user(user_id=027b7c0fc733485d9ab6fd17037e8200)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.202510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.205220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1076/2156] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:28.205220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3ca-ac6c-4f6e-85c0-93f34b5f45b8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.205520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3ca-ac6c-4f6e-85c0-93f34b5f45b8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.205847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3ca-ac6c-4f6e-85c0-93f34b5f45b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.225962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2bc2d3ca-ac6c-4f6e-85c0-93f34b5f45b8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:28.227914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2bc2d3ca-ac6c-4f6e-85c0-93f34b5f45b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.238571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1077/2157] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:28.240011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.240402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.240775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.269159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:28.270284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.272379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027b7c0fc733485d9ab6fd17037e8200'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.273052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027b7c0fc733485d9ab6fd17037e8200'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.284226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027b7c0fc733485d9ab6fd17037e8200'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.285172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1078/2158] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:28.285980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.287422 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.302195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b29e5-0d70-4367-b7e5-eefdd8d3b072 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.307155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.308700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.308700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.308700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.309292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.311501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.316272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027b7c0fc733485d9ab6fd17037e8200'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.317620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027b7c0fc733485d9ab6fd17037e8200'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.335495 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1081/2159] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:28 2022] DELETE /identity/v3/users/027b7c0fc733485d9ab6fd17037e8200 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:28.338575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.338575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.366011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1079/2160] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.366011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.481864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be751-fe00-44c5-a394-3c76ec82893c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.483046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923501c2-24ba-427f-ab21-a39d3ebf03c4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.489253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.489996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.490369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.490726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.491714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:28.493081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.495502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.502767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.504320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.504914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.505853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.507288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:28.507787 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.511907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.537706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:28.538591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1080/2161] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:28.542561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.551197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1082/2162] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:28.552711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.566621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12d37-e8b5-4104-8d5c-4f54beb32723 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.580312 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4eaf1-6276-4727-ba2a-54525d5834dd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.580936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.581628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.581900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.582179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.584684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.591884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.602702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.603401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.603843 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.604155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.605006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.607138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.637470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1081/2163] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.637866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.654609 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037e35-2ca8-4679-a31a-67096b789759 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.661032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1083/2164] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.661590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.662490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.662731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.663275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.663590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.664279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.667498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.704812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1082/2165] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.706211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.769096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e20c21-e351-4e98-8ab3-3db005155fd8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.795658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686b64-2bec-40ea-9d8c-a805b26f7db5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.808016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.808716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.808997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.809279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.810301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.812558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.843377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1083/2166] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.844337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.852273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:28.856271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b31fd2-686b-4253-8500-fb6a6ebe3383 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.861112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.861865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.862093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.862366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.862810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.863161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.863575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.863974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.864353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.864837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.865235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.867277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.878580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1084/2167] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:28.878580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.878580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:28.892427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569b83-4b08-4193-a31e-04e79eb9f044 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.893249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1084/2168] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:28 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:28.894271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.901030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.901923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.902187 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.902463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] PATH_INFO: `/v3/projects/feb279486da245949103f0777ef049f0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.903825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb279486da245949103f0777ef049f0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.906211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.906709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b79e-6263-4e44-9b53-85af92ed0cad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.911644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.912314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.912589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.912863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.913604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.915305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.929831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1085/2169] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:28.929831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.939619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bee6f1-5fb7-4b4b-8bb0-646758b8310c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.944914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:28.945846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:28.946196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:28.946489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:28.947231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:28.948892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:28.962532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1086/2170] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:28.962532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:28.970673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb279486da245949103f0777ef049f0', 'request_id': 'req-fdd31152-690c-4e7a-8867-cc4ff2a5886d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.973012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bad65-a92e-4a26-bfe5-a0c99866b842 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:28.977442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb279486da245949103f0777ef049f0', 'request_id': 'req-fdd31152-690c-4e7a-8867-cc4ff2a5886d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.983618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb279486da245949103f0777ef049f0', 'request_id': 'req-fdd31152-690c-4e7a-8867-cc4ff2a5886d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.997785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] The token cache is being invalidate because project feb279486da245949103f0777ef049f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:28.998066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:28.998692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:29.000338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1085/2171] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:28 2022] DELETE /identity/v3/projects/feb279486da245949103f0777ef049f0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:29.001116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.002590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.009821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.036432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.037106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.037384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.037656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.038393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.040140 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.050280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1087/2172] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:29.050835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.052491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.065229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b2dd4-41cb-4210-83de-61bb9d16838e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.069890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.070796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.071438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.071842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] PATH_INFO: `/v3/projects/0a27dba81375476893fda0dd03c0af82/users/d1cc70ba6f864782841e9a1f42d27148/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.075497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd31152-690c-4e7a-8867-cc4ff2a5886d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.080681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.081501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.081849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.082122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.082833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.084487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812439d9-d9ee-4d10-8987-5fc79ce3c9d8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.088055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a27dba81375476893fda0dd03c0af82, user_id=d1cc70ba6f864782841e9a1f42d27148, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.090735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.095240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1086/2173] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:29.096625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.096953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.097265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.105159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1088/2174] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:29 2022] PUT /identity/v3/projects/0a27dba81375476893fda0dd03c0af82/users/d1cc70ba6f864782841e9a1f42d27148/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:29.115338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.115338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.121965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.123267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.178827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1377cfe-1127-42be-a0e8-e2538e9eb51e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.184027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1087/2175] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:29.184993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.185711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.185986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.186260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.186981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.188429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.188667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecce2c-e0fe-4a4e-978a-8bbbb0a23f31 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.202379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f07fb6-9b98-44ef-aacf-af879374f3a3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.203121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1089/2176] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:29.204484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.204770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.205045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.213024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.213982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.214265 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.214541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] PATH_INFO: `/v3/projects/72bda4cbb07a43688506e01d06ba89c2/users/805854e5ce2e412fb9420afd63f73ee6/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.230883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bda4cbb07a43688506e01d06ba89c2, user_id=805854e5ce2e412fb9420afd63f73ee6, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.233580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc416ae-77c6-41eb-8b7c-57b1664c2d2a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.233910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] MFA Rules not processed for user `d1cc70ba6f864782841e9a1f42d27148`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.235106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.248345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1088/2177] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:29 2022] PUT /identity/v3/projects/72bda4cbb07a43688506e01d06ba89c2/users/805854e5ce2e412fb9420afd63f73ee6/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:29.249701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec8e9-7164-4e1b-a694-b9a1b0ff21fb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.249980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec8e9-7164-4e1b-a694-b9a1b0ff21fb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.250241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec8e9-7164-4e1b-a694-b9a1b0ff21fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.260718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.267381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98eec8e9-7164-4e1b-a694-b9a1b0ff21fb None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.268607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98eec8e9-7164-4e1b-a694-b9a1b0ff21fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.310197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1090/2178] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:29.310197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.320303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737dc2b-f76d-4acc-925b-c567400c281c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.326831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1089/2179] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:29.328148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.328436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.328710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.345933 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.347122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.355261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1090/2180] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:29.356169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.367035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929e0f5-5dc8-4fc1-83d6-6e28e2e763ae None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.372498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.373494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.373783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.374070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.374751 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.376707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.380976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.381683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.382240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.382519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.382790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] PATH_INFO: `/v3/projects/4d442cadf7f14801ad1ac808bead3828/users/06eb4f715579467fa8b9b887d5c9ccc8/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.399074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d442cadf7f14801ad1ac808bead3828, user_id=06eb4f715579467fa8b9b887d5c9ccc8, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.401867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.405746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1091/2181] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:29.406676 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.420018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1091/2182] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:29 2022] PUT /identity/v3/projects/4d442cadf7f14801ad1ac808bead3828/users/06eb4f715579467fa8b9b887d5c9ccc8/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:29.420907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.422533 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.481929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960a7c-a0a2-4589-8686-7209cd56187a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.485644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.485889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53544ea4-a203-423f-ada4-a0b3c8a54aa1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.486289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.486558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.486825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.561049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.561742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.562025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.562300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.563099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:29.563506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.566320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.566610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.569230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.571039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda802d0-49aa-4cbb-842c-c880d501f5ee service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.583452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1092/2183] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:29.583452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.589190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1092/2184] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:29.591139 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.591426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.591725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.599221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c887a32-01b5-4f6b-88a9-2b1937ff90b3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.608091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.609827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.610296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.610809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.612000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.614154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.624254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] MFA Rules not processed for user `06eb4f715579467fa8b9b887d5c9ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.625915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.641842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1093/2185] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/users => generated 298 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:29.642986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.655794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b412a1-f4dc-43a7-a45f-3aabd36681d1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.671274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.672112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.672438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.672828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.673801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.675984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.716532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1094/2186] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:29.717696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.719902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1093/2187] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:29.722892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.736347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e92d4-1e15-476c-a9dd-e93412f4ba30 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.778482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.803414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d348b3-7e0f-465b-9094-5a73545d86e8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.809342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.810062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.810360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.810615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.810799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.811431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.811731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.812132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.813110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.813196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.813286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.815982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.824430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1095/2188] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:29.825339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.837655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd539f-9274-4f4e-ba3a-ff4e9f8041ea admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.840688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1094/2189] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:29.844935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.845801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.847151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.847419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.847734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.848654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.850739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.858297 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78b42-a0b1-44da-b57b-da69ecc188d1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.863364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.864314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.864596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.864868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] PATH_INFO: `/v3/projects/4dfd1329dbc3401f9a404e56310b7d85/users/4d6ae5b6c77f4096afabcd7f33dde055/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.883122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfd1329dbc3401f9a404e56310b7d85, user_id=4d6ae5b6c77f4096afabcd7f33dde055, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.886316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.890848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1096/2190] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:29.893238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.902639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1095/2191] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:29 2022] PUT /identity/v3/projects/4dfd1329dbc3401f9a404e56310b7d85/users/4d6ae5b6c77f4096afabcd7f33dde055/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:29.902955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.964898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:29.993550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5799-d25d-4ca4-9171-7392d49b9d71 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.994645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03d3ad-23d8-4302-81cb-8ceaf1797efa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.008004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.008920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.009276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.009662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.010486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.013456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.016626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.017290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.017602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.017923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.020556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.026329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.028816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1097/2192] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.029810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.058164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0a9c-1f55-417b-a549-990203176cde admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.065063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1096/2193] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:30.066059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.069722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.071372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.071694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.071972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.072866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.075214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.077543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd9bf2-9b9e-4959-8e65-42469ff54ad0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.082370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.083091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.083511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.084324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.085231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.087950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.090719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1098/2194] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.091766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.110907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1097/2195] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.110907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.111653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663a960-812b-42c7-abdc-1ddd3fb5dc8e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.117925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.118703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.119020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.119316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.120100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.121763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.122084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a494a-b82b-404d-ae56-1e67d4a163e6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.128061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.129469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.129469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.129854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] PATH_INFO: `/v3/projects/4dfd1329dbc3401f9a404e56310b7d85/users/4d6ae5b6c77f4096afabcd7f33dde055/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.132491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfd1329dbc3401f9a404e56310b7d85, user_id=4d6ae5b6c77f4096afabcd7f33dde055, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.135087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1099/2196] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.135648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.139189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.148302 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78409a5a-c9cd-4fcd-97c1-92f2f58f5a72 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.155654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1098/2197] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:30 2022] PUT /identity/v3/projects/4dfd1329dbc3401f9a404e56310b7d85/users/4d6ae5b6c77f4096afabcd7f33dde055/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:30.155654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.223519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.224462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.224744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.224902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c004-ca96-4253-b109-0fb056680bef admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.225000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] PATH_INFO: `/v3/projects/3d4a939274e94bc2aea3a041002db4c3/users/3f5e8f6ced4544448a4c394b7ddc145e/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.230347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.231324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.231724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.232063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] PATH_INFO: `/v3/projects/134b6ae4ae784e7a9860893146c590e3/users/29a38355d4834f8086e0278521b0ee27/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.241308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4a939274e94bc2aea3a041002db4c3, user_id=3f5e8f6ced4544448a4c394b7ddc145e, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.244243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37140c-85f5-45c9-ac82-021705028635 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.248557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134b6ae4ae784e7a9860893146c590e3, user_id=29a38355d4834f8086e0278521b0ee27, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.251649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37660e-692f-4bfb-9edd-02285cc22577 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.259311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1100/2198] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:30 2022] PUT /identity/v3/projects/3d4a939274e94bc2aea3a041002db4c3/users/3f5e8f6ced4544448a4c394b7ddc145e/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:30.260640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.260882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.261166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.277315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1099/2199] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:30 2022] PUT /identity/v3/projects/134b6ae4ae784e7a9860893146c590e3/users/29a38355d4834f8086e0278521b0ee27/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:30.280273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca993-97b2-4716-a7ef-ff6137ca5ac3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.280273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca993-97b2-4716-a7ef-ff6137ca5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.280273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca993-97b2-4716-a7ef-ff6137ca5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.292031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] MFA Rules not processed for user `4d6ae5b6c77f4096afabcd7f33dde055`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:30.293410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.304421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:30.316666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-999ca993-97b2-4716-a7ef-ff6137ca5ac3 None None] MFA Rules not processed for user `3f5e8f6ced4544448a4c394b7ddc145e`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:30.318949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-999ca993-97b2-4716-a7ef-ff6137ca5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.386308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1101/2200] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:30.387411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.396853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1100/2201] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:30.398673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.399301 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.399837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.430783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] MFA Rules not processed for user `805854e5ce2e412fb9420afd63f73ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:30.432328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.450427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:30.468117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139bdf7-9311-4715-bccc-dbbe7a893285 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.473929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.474614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.474894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.475167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.475941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.477649 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.488452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1102/2202] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.489483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.499591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c1752-71f3-4f49-9ea5-3f6280a17d33 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.504480 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.505131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.505410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.505689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.506496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.508800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.510279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1101/2203] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:30.511276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.512950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.548678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1103/2204] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:30.549594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.574056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9de9c-d080-46fa-9379-ffc9dbeccedd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.622158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b400d2-e82f-4685-9082-235696b2784e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.626379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.626943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.627168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.627409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.627741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.627884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.628164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.628431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] PATH_INFO: `/v3/projects/134b6ae4ae784e7a9860893146c590e3/users/29a38355d4834f8086e0278521b0ee27/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.630542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134b6ae4ae784e7a9860893146c590e3, user_id=29a38355d4834f8086e0278521b0ee27, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.634850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.649466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1104/2205] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:30 2022] PUT /identity/v3/projects/134b6ae4ae784e7a9860893146c590e3/users/29a38355d4834f8086e0278521b0ee27/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:30.650581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.652193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.669423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:30.693067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.694624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.709635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1102/2206] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:30.710468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.721399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296219-f03c-4166-9eb3-c4ccd99ebe44 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.725348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a2bd0-c9f1-4114-b83b-c0dc3fee0f06 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.731517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.732252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.732536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.732810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.757558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:30.799597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.801597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21100e3-570f-47e2-92a9-8205989dcbf7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.806531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.808465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.808903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.809313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.810513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.813172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1105/2207] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:30.813916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.825017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.825835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.826410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.859023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1103/2208] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:30.863137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.865203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] MFA Rules not processed for user `29a38355d4834f8086e0278521b0ee27`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:30.866824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.886902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa83d-7672-493b-ab44-82a52f75d539 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.901523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.903153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.903435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.905352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.906513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.913325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.941279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1104/2209] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:30.942158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.954852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b2e5-4da9-488d-ad25-c3eb306e7412 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.963340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.963888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1106/2210] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:30.965072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.965361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.965636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] PATH_INFO: `/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6/users/e4d9805555a746aa82661c44e6cd7bce/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.984916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b24d1f5b8d64c91b32835af772fc9b6, user_id=e4d9805555a746aa82661c44e6cd7bce, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.988145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.008128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1105/2211] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:30 2022] PUT /identity/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6/users/e4d9805555a746aa82661c44e6cd7bce/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:31.013958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.027399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219898dd-0d0f-4a97-83bd-626f76cc3112 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.083995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.094508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.095272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.095582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.095862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.096605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.098226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e66159-cd9a-44e6-8208-753f5358ef30 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.109297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1107/2212] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:31.113491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.125771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f0c6-2e35-480a-8a07-10e8405d0909 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.131049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.136048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.136048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.136048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] PATH_INFO: `/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6/users/e4d9805555a746aa82661c44e6cd7bce/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.137424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b24d1f5b8d64c91b32835af772fc9b6, user_id=e4d9805555a746aa82661c44e6cd7bce, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.140645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.159905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1106/2213] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:31 2022] PUT /identity/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6/users/e4d9805555a746aa82661c44e6cd7bce/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:31.170699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.170991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.171269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.176453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.207630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] MFA Rules not processed for user `e4d9805555a746aa82661c44e6cd7bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:31.209241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:31.262385 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789375-26e4-49a2-9580-23adbb09b334 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.268277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.269866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.270215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.270504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.307577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1108/2214] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:31.349364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.351084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.361801 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1107/2215] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:31.455450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.465399 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7cbf6-7450-4fc1-a134-a37f3148788d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.469342 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.469983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.470261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.470531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.536330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.537839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9162-a2f7-4047-9143-40c01420ecf9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.547616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1109/2216] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:31.550050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.558991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac129-7c8c-45a4-b379-9c39a6ddf754 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.562690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.563320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.563624 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.563899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.581776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.624013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.625481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.635577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1108/2217] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:33.600095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5285-cf5b-474e-bf25-3ecab81fe5f6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:33.600677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5285-cf5b-474e-bf25-3ecab81fe5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:33.601110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5285-cf5b-474e-bf25-3ecab81fe5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:33.620244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-414d5285-cf5b-474e-bf25-3ecab81fe5f6 None None] MFA Rules not processed for user `805854e5ce2e412fb9420afd63f73ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:33.621544 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-414d5285-cf5b-474e-bf25-3ecab81fe5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:33.700566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1110/2218] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:37.952288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:37.953871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.022825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755ba5-17cc-4879-85fe-fd74fee21ac1 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.029291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.030226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.030504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.030772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] PATH_INFO: `/v3/users/4eefe9661863485fa71d18bbd6351852` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.032049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eefe9661863485fa71d18bbd6351852)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.034021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.088067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eefe9661863485fa71d18bbd6351852'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.088844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eefe9661863485fa71d18bbd6351852'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.089589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eefe9661863485fa71d18bbd6351852'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.102101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eefe9661863485fa71d18bbd6351852'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.110022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eefe9661863485fa71d18bbd6351852'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.123451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1109/2219] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:37 2022] DELETE /identity/v3/users/4eefe9661863485fa71d18bbd6351852 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:38.129388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.129849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.130094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.150254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:38.151434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.163872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:38.213935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1111/2220] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:38.224248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.226043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.270779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:38.289476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897b2-b4e0-4a49-9f26-ee1b48e1ce7f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.293604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.294273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.294562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.294839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.304758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.306668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30844d55-c300-4909-b8a9-bafd28427f71 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.318871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1110/2221] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:38.353020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.354550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.366729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b612bec-9d45-408b-a9a5-db4b59f6b0b4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.371720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.372617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.372900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.373272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] PATH_INFO: `/v3/users/3f5e8f6ced4544448a4c394b7ddc145e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.374504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e8f6ced4544448a4c394b7ddc145e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.376563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.441129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e8f6ced4544448a4c394b7ddc145e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.441801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e8f6ced4544448a4c394b7ddc145e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.450653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e8f6ced4544448a4c394b7ddc145e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.465419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e8f6ced4544448a4c394b7ddc145e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.466727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e8f6ced4544448a4c394b7ddc145e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.488846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1112/2222] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:38 2022] DELETE /identity/v3/users/3f5e8f6ced4544448a4c394b7ddc145e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:38.494033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.494352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.494631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.520926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:38.520926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.529116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.531085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.585282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1111/2223] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:38.596038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.597495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.603443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c4dd-8030-46df-8b6c-c8e2581ec1e2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.607338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.608034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.608308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.608578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.610541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.666341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b01de3-31ac-45fe-94b7-efc5a2b5d878 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.670572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:38.672070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.672954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.672954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.673315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.684038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.685574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.693958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.695473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.696089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1112/2224] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:38.697008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.698311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:38.706371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1113/2225] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:38.712281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b28916-3e4c-4128-9ba6-14ae4788ba68 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.718335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.719294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.719660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.720010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] PATH_INFO: `/v3/projects/f3e65c4161a24a3e93b9c2e4c35e3800` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.721451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e65c4161a24a3e93b9c2e4c35e3800)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.723434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.790485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e65c4161a24a3e93b9c2e4c35e3800', 'request_id': 'req-9e2946ec-6012-4d98-9707-af14947e72bd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.800567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e65c4161a24a3e93b9c2e4c35e3800', 'request_id': 'req-9e2946ec-6012-4d98-9707-af14947e72bd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.809369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e65c4161a24a3e93b9c2e4c35e3800', 'request_id': 'req-9e2946ec-6012-4d98-9707-af14947e72bd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.831047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] The token cache is being invalidate because project f3e65c4161a24a3e93b9c2e4c35e3800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:38.831496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.832202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:38.838283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1113/2226] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:38 2022] DELETE /identity/v3/projects/f3e65c4161a24a3e93b9c2e4c35e3800 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:38.839239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.858180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b007-c45d-4f0a-9b35-b28e7ae2e7c0 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.945578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.946506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.946818 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.947228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] PATH_INFO: `/v3/users/b25150d52091440884087e9d6b74fa3d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.948981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25150d52091440884087e9d6b74fa3d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.950979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.022881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25150d52091440884087e9d6b74fa3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.023598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25150d52091440884087e9d6b74fa3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.031442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25150d52091440884087e9d6b74fa3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.064650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25150d52091440884087e9d6b74fa3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.065784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25150d52091440884087e9d6b74fa3d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.074920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.077351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.084901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1114/2227] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:38 2022] DELETE /identity/v3/users/b25150d52091440884087e9d6b74fa3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:39.099690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2946ec-6012-4d98-9707-af14947e72bd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.104939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:39.174561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.175709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.176064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.176365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] PATH_INFO: `/v3/projects/3d4a939274e94bc2aea3a041002db4c3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.177948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4a939274e94bc2aea3a041002db4c3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.180828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.244596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4a939274e94bc2aea3a041002db4c3', 'request_id': 'req-3c21228d-df5a-4481-94fc-53e8da2c77da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.255908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4a939274e94bc2aea3a041002db4c3', 'request_id': 'req-3c21228d-df5a-4481-94fc-53e8da2c77da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.262910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4a939274e94bc2aea3a041002db4c3', 'request_id': 'req-3c21228d-df5a-4481-94fc-53e8da2c77da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.284330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] The token cache is being invalidate because project 3d4a939274e94bc2aea3a041002db4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:39.284627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.285356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.287117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1114/2228] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:39 2022] DELETE /identity/v3/projects/3d4a939274e94bc2aea3a041002db4c3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:39.291269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.292737 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.305281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d689-29d1-4a23-8dca-a9412a1cea13 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.373073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.373971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.374253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.374528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] PATH_INFO: `/v3/users/e4d9805555a746aa82661c44e6cd7bce` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.375813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d9805555a746aa82661c44e6cd7bce)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.377735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.379374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:39.430784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.432747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.439768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d9805555a746aa82661c44e6cd7bce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.440685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d9805555a746aa82661c44e6cd7bce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.445409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21228d-df5a-4481-94fc-53e8da2c77da admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.449600 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d9805555a746aa82661c44e6cd7bce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.450712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.451614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.451896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.452166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] PATH_INFO: `/v3/projects/062dbe8e60f04024ba789160e0e093a3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.453345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062dbe8e60f04024ba789160e0e093a3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.455321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.469063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d9805555a746aa82661c44e6cd7bce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.469820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-653c6cf2-d928-4272-b788-645b1ec51e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d9805555a746aa82661c44e6cd7bce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.483726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1115/2229] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:39 2022] DELETE /identity/v3/users/e4d9805555a746aa82661c44e6cd7bce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:39.506830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062dbe8e60f04024ba789160e0e093a3', 'request_id': 'req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.514549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062dbe8e60f04024ba789160e0e093a3', 'request_id': 'req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.520491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062dbe8e60f04024ba789160e0e093a3', 'request_id': 'req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.539286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] The token cache is being invalidate because project 062dbe8e60f04024ba789160e0e093a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:39.540037 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.540307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-aac6d0bf-c1d2-437e-ad1e-8100d764bee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.542129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1115/2230] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:39 2022] DELETE /identity/v3/projects/062dbe8e60f04024ba789160e0e093a3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:39:39.547346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.547683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.547984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.567983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:39.569222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.631055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1116/2231] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:39.639641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.639938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.640253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.661002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:39.662206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.670397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1116/2232] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:39.674773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.685378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4609e-3d06-4c68-bb9e-532682487d35 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.690720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.691429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.691742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.692018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.692775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:39.693084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.694746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.708776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1117/2233] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:39:39.713755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.723225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a75b-a30a-4b67-a074-632086e46354 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.728857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.729521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.729829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.730100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.730796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.732767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.743075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:39.762540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1117/2234] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:39.766817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.768587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.770517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.784205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2306-23df-47d1-950f-e98806e3f408 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.852095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.852872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.852999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942a2d-fa16-40fe-986b-5fac31db5123 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.853160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.853432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.854143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.856115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.858250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.859126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.859402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.859713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] PATH_INFO: `/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.861549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b24d1f5b8d64c91b32835af772fc9b6)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.863505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.866049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:39.879086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1118/2235] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:39.883378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.894385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c34d3b-6ddc-4070-8d99-43125422948f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.900001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.900674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.901016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.901301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.901951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.903586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.914335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1119/2236] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:39:39.917809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b24d1f5b8d64c91b32835af772fc9b6', 'request_id': 'req-3daf8ad7-2f5f-4286-b621-5ee6cde68402'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.918960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.925633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b24d1f5b8d64c91b32835af772fc9b6', 'request_id': 'req-3daf8ad7-2f5f-4286-b621-5ee6cde68402'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.929673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442860b-bc55-47e4-bc59-50ddb041a016 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.940474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b24d1f5b8d64c91b32835af772fc9b6', 'request_id': 'req-3daf8ad7-2f5f-4286-b621-5ee6cde68402'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.947266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] The token cache is being invalidate because project 2b24d1f5b8d64c91b32835af772fc9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:39.947567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.948201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3daf8ad7-2f5f-4286-b621-5ee6cde68402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:39.949829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1118/2237] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:39 2022] DELETE /identity/v3/projects/2b24d1f5b8d64c91b32835af772fc9b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:39.954384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dcb2-5a4c-41ee-bc28-eeebb71fdd5f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.954661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dcb2-5a4c-41ee-bc28-eeebb71fdd5f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.954929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dcb2-5a4c-41ee-bc28-eeebb71fdd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.973612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9320dcb2-5a4c-41ee-bc28-eeebb71fdd5f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:39.974813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9320dcb2-5a4c-41ee-bc28-eeebb71fdd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.988449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.989116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.989393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.989661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.990385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.992020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.005343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1120/2238] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:40.006368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.008251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.020848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602faeec-0079-48a1-a493-877f8dc0f151 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.026739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.027646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.027930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.028481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] PATH_INFO: `/v3/projects/c4f1fc7f1e624a3ab3801595cabd0d63/users/12b28044c97544c8a76803531984fa7b/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.037425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1119/2239] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:40.044879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f1fc7f1e624a3ab3801595cabd0d63, user_id=12b28044c97544c8a76803531984fa7b, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.045781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.046069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.046345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.048764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36735d60-6ed4-4147-ae0e-54839d91eb40 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.066929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:40.068686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1121/2240] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:40 2022] PUT /identity/v3/projects/c4f1fc7f1e624a3ab3801595cabd0d63/users/12b28044c97544c8a76803531984fa7b/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:40.068914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.079650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.079940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.080218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.088509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:40.109033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] MFA Rules not processed for user `12b28044c97544c8a76803531984fa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:40.110283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.146569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1120/2241] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:40.152562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.162061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a568b5-9878-403d-a2af-07e1bb4023f6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.167380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.167937 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.168381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.168655 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.169585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:40.169892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.172560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.191109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1122/2242] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:40.195448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1121/2243] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:40.196326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.202403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.204276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.208414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fcb8d-1588-4a53-9f95-e67717ae9a12 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.213258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.215761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.216095 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.216424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.217201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.219111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.245190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1123/2244] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:40.249266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.269629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aea6b-4c29-47a7-a436-6f6e2bfebdd8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.277714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:40.313798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1f32-229b-4b22-bb09-a302859fcee6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.326054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.326762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.327101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.327375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.328112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.328423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.329079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.329355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.329623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.330130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.355013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1124/2245] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:40.356020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.365925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4241e7-2e69-40d9-b210-76af67ae7a56 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.371091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.371907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.372202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.372442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.373176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.374846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.386127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1125/2246] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:39:40.390021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.400188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142620-f597-4711-878d-dc240f502cf3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.401842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.403368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.405104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.405849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.406193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.406556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.407355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.409055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.414331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1122/2247] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:40.434133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1126/2248] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:40.434250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.435219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.444873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae6d6-5ff2-4d3e-b871-4299d227a672 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.446073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0b78c-f903-4e93-911e-95297583fc59 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.449777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.450790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.451124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.451252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.451592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] PATH_INFO: `/v3/projects/4859bcdae1924dd0a40f2f00e9c46a21/users/9299dcf01b4c407286b54f9379bd71dd/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.452201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.452481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.452813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] PATH_INFO: `/v3/users/12b28044c97544c8a76803531984fa7b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.453996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b28044c97544c8a76803531984fa7b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.457102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.469346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4859bcdae1924dd0a40f2f00e9c46a21, user_id=9299dcf01b4c407286b54f9379bd71dd, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.472841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d955e-2b4c-4658-8d3d-09ee122573c5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.477600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:40.491454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1123/2249] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:40 2022] PUT /identity/v3/projects/4859bcdae1924dd0a40f2f00e9c46a21/users/9299dcf01b4c407286b54f9379bd71dd/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:40.502371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.502963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.502963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.511869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b28044c97544c8a76803531984fa7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:40.512540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b28044c97544c8a76803531984fa7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:40.520161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b28044c97544c8a76803531984fa7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:40.533253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] MFA Rules not processed for user `9299dcf01b4c407286b54f9379bd71dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:40.534461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.535433 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b28044c97544c8a76803531984fa7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:40.536276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80c37e8d-a088-409b-9130-3d6add8f8ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b28044c97544c8a76803531984fa7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:40.550709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1127/2250] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:39:40 2022] DELETE /identity/v3/users/12b28044c97544c8a76803531984fa7b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:40.555355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.555681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.556126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.573299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:40.574496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.600868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1124/2251] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:40.612339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.613800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.637508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1128/2252] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:40.647969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:40.649428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:40.655850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:40.677689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d8e07-221f-4402-98bf-725c64fce441 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.710616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743e22-3c3c-4d49-a23b-093cee3c2770 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:40.714824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.715746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.715863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.716053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.726001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.726165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:40.726731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:40.727016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:40.727294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:40.727462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.737827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1129/2253] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:40.789263 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:40.792488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:40.794450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704b5e-05e2-40ff-a5b4-7d12d5d2cb03 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:40.805404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1125/2254] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:41.027137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.028742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:41.043228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704af41-f336-408f-abde-d4040d082788 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.048785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.049741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.049939 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.050268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] PATH_INFO: `/v3/projects/c4f1fc7f1e624a3ab3801595cabd0d63` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.051681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f1fc7f1e624a3ab3801595cabd0d63)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.054002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.126708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f1fc7f1e624a3ab3801595cabd0d63', 'request_id': 'req-b37342bf-a0c3-4c00-a60e-464388b9c90b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:41.133661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f1fc7f1e624a3ab3801595cabd0d63', 'request_id': 'req-b37342bf-a0c3-4c00-a60e-464388b9c90b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:41.140839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f1fc7f1e624a3ab3801595cabd0d63', 'request_id': 'req-b37342bf-a0c3-4c00-a60e-464388b9c90b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:41.154647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] The token cache is being invalidate because project c4f1fc7f1e624a3ab3801595cabd0d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:39:41.154928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:41.155574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b37342bf-a0c3-4c00-a60e-464388b9c90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:39:41.157138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1130/2255] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:39:41 2022] DELETE /identity/v3/projects/c4f1fc7f1e624a3ab3801595cabd0d63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:41.163133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.163720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.163720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.182611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:41.183944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:41.251523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1126/2256] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:41.259528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.259845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.260123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.279937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:41.281207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:41.289822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1131/2257] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:41.294182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.304699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5814-82da-4ed6-876d-7307acae8f2f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.310221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.310868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.311155 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.311418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.312201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:39:41.312508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.314141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.326781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1127/2258] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:39:41.331198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.341135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae55c8-239b-4e13-bf23-d2af93387329 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.345924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.346583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.346858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.347120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.348100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.350206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.380311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1132/2259] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:39:41 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:39:41.384641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.394969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e7cd-4956-4857-af06-8d8f1c7d285d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.457027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.457696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.457973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.458231 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.458935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.460908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.482677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1128/2260] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:39:41 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:39:41.486963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.497716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b31e3-6f4f-4b75-846f-9f8afd61d560 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.502681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.503340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.503650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.503918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.504678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.506293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.516884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1133/2261] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:41.520878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.531353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3098dd-64a8-4cf7-87b7-40026ae502b4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.536554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.537201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.537478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.537722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.538450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.540117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b944c69-2554-4f8f-96b1-cd98d004dbb3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.550260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1129/2262] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:41.554483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.564689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd92b-8d76-4d70-b830-d056b12f9d0f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.569497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.570396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.570664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.572210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] PATH_INFO: `/v3/projects/788fae779c8a4b5a8cfc6a1d5053346b/users/d4c1a33a687d4a71a2e7e9c280782598/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.587804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=788fae779c8a4b5a8cfc6a1d5053346b, user_id=d4c1a33a687d4a71a2e7e9c280782598, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.590459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.606059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1134/2263] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:39:41 2022] PUT /identity/v3/projects/788fae779c8a4b5a8cfc6a1d5053346b/users/d4c1a33a687d4a71a2e7e9c280782598/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:39:41.617570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.618056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.618471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.648923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] MFA Rules not processed for user `d4c1a33a687d4a71a2e7e9c280782598`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:41.650212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:41.707434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:41.725077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1130/2264] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:41.736189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:41.738213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:41.771561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:41.803275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdc573-716c-4f53-8e4d-3975d8a3261e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:41.808126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:41.808777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:41.809056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:41.809329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:41.818417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:41.819962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880d14-9895-49d5-ac9c-0d4f9bb7cb0b service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:41.829213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1135/2265] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:51.722157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:51.825166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=14 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:13.702285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:13.703749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:13.838987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885334-e2e2-40b0-985e-89a80a80349a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:13.843722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:13.844606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:13.844876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:13.845142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] PATH_INFO: `/v3/users/06eb4f715579467fa8b9b887d5c9ccc8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:13.846333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06eb4f715579467fa8b9b887d5c9ccc8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:13.848305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:13.895486 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06eb4f715579467fa8b9b887d5c9ccc8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:13.896498 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06eb4f715579467fa8b9b887d5c9ccc8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:13.897119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06eb4f715579467fa8b9b887d5c9ccc8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:13.909031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06eb4f715579467fa8b9b887d5c9ccc8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:13.916057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06eb4f715579467fa8b9b887d5c9ccc8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:13.930917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1131/2266] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:40:13 2022] DELETE /identity/v3/users/06eb4f715579467fa8b9b887d5c9ccc8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:13.935477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:13.936022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:13.936112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:13.968414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:13.969703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:14.030313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1136/2267] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:14.041300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:14.042980 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:14.066736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:14.150392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bdf3-a240-4db2-803a-2c21697e64d2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:14.154159 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:14.154799 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.155074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.155344 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.164403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:14.166245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:14.175475 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1132/2268] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:14.474456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:14.476034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:14.488616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9171d2-387a-4649-9e1d-f177acd3134a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:14.494006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:14.494880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.495192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.495468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] PATH_INFO: `/v3/projects/4d442cadf7f14801ad1ac808bead3828` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.496828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d442cadf7f14801ad1ac808bead3828)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:14.498761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:14.558427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d442cadf7f14801ad1ac808bead3828', 'request_id': 'req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.564545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d442cadf7f14801ad1ac808bead3828', 'request_id': 'req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.570145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d442cadf7f14801ad1ac808bead3828', 'request_id': 'req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.583039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] The token cache is being invalidate because project 4d442cadf7f14801ad1ac808bead3828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:14.583329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.583955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.585488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1137/2269] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:40:14 2022] DELETE /identity/v3/projects/4d442cadf7f14801ad1ac808bead3828 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:14.589789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:14.599575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d285e-8ad3-48d8-916a-e28578b95b0c service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:14.657740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:14.658614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.658890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.659218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] PATH_INFO: `/v3/users/29a38355d4834f8086e0278521b0ee27` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.660323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a38355d4834f8086e0278521b0ee27)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:14.662259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:14.711379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a38355d4834f8086e0278521b0ee27'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.712129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a38355d4834f8086e0278521b0ee27'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.712745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a38355d4834f8086e0278521b0ee27'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.724920 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a38355d4834f8086e0278521b0ee27'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.732650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32b4a1e8-7cba-4477-967b-0785e3eb6b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a38355d4834f8086e0278521b0ee27'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:14.748256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1133/2270] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:40:14 2022] DELETE /identity/v3/users/29a38355d4834f8086e0278521b0ee27 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:40:15.069696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.071123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:15.083958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5383-3d14-41b6-90bb-0ef60aa4e1e4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.160346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.161223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.161512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.161798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] PATH_INFO: `/v3/projects/134b6ae4ae784e7a9860893146c590e3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.163015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] RBAC: Authorizing `identity:delete_project(project_id=134b6ae4ae784e7a9860893146c590e3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.165003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.186614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:15.218560 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134b6ae4ae784e7a9860893146c590e3', 'request_id': 'req-ba43f09e-2a12-4166-a95e-b961c13e854f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:15.224667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134b6ae4ae784e7a9860893146c590e3', 'request_id': 'req-ba43f09e-2a12-4166-a95e-b961c13e854f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:15.230098 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134b6ae4ae784e7a9860893146c590e3', 'request_id': 'req-ba43f09e-2a12-4166-a95e-b961c13e854f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:15.244463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] The token cache is being invalidate because project 134b6ae4ae784e7a9860893146c590e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:15.244745 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:15.245361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ba43f09e-2a12-4166-a95e-b961c13e854f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:15.246919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1138/2271] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:40:15 2022] DELETE /identity/v3/projects/134b6ae4ae784e7a9860893146c590e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:15.252068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.252355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.252625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.257294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:15.309220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:15.310433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:15.381082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1134/2272] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:15.389301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.389591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.389896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.411441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:15.412767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:15.422033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1139/2273] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:15.426614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.437205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbaa17-e792-403a-b4f1-24d2bc1bb5b9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.442451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.443116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.443397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.443716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.444461 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:40:15.444770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.446408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.458839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1135/2274] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:40:15.463815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.474128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d9aa1-c9e1-4b0c-b50f-dc6aa3917d59 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.479807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.480591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.480878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.481146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.481881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.483828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.512956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1140/2275] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:15.519560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.532049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be4ac2-99fc-42cd-869e-eef2b3d3a0a8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.592752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.593362 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.593645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.593913 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.594598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.596595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.619157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1136/2276] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:15.624200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.641260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101eadd-b4df-4c9e-b338-f588e93b0490 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.648929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.649612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.649899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.650198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.651107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.652796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.664468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1141/2277] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:15.669820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.681649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfa4f3-cac7-4cb9-881d-56dbda6e854d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.686679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.687379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.687708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.687984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.688706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.690349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bda80-f958-49c9-a758-d72e3a1ab334 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.701168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1137/2278] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:15.705572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.715741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdc92-76e7-4a11-bf37-41323265191b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.720630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.721529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.721811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.722087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] PATH_INFO: `/v3/projects/c2dc0b933d9e48e9af5bd1c1171fbd24/users/a3a5bff05b3a4990aec4e7a9670dfa91/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.737337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dc0b933d9e48e9af5bd1c1171fbd24, user_id=a3a5bff05b3a4990aec4e7a9670dfa91, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.740142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.755353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1142/2279] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:40:15 2022] PUT /identity/v3/projects/c2dc0b933d9e48e9af5bd1c1171fbd24/users/a3a5bff05b3a4990aec4e7a9670dfa91/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:15.767568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.768108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.768108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.808957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] MFA Rules not processed for user `a3a5bff05b3a4990aec4e7a9670dfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:15.810606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:15.852833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:15.885253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1138/2280] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:15.889926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.956074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6024-7a07-4e16-acd0-41e45930b3b5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.961246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.961904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.962180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.962450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.963380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.965370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.993766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1143/2281] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:15.997904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.009818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3914-b5f2-47dc-bf65-95956f9bd2a3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.071636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.072435 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.072712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.073001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.073723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.075679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.100210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1139/2282] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:16.102110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.113450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7de1-2036-42c1-afbd-86f4e0342366 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.118752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.119442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.119761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.120036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.120771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.122373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.134595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1144/2283] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:16.139512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.150894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd177b-f0fc-4540-827a-d319d2ce76fd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.155825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.156703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.156968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.157243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] PATH_INFO: `/v3/projects/a727cf4a4cbe4e579689242005ba9439/users/f17b8cd079aa41abad882d554d8b7928/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.175200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a727cf4a4cbe4e579689242005ba9439, user_id=f17b8cd079aa41abad882d554d8b7928, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.177972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.191934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1140/2284] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:40:16 2022] PUT /identity/v3/projects/a727cf4a4cbe4e579689242005ba9439/users/f17b8cd079aa41abad882d554d8b7928/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:40:16.195915 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.206538 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d91b3-39b4-4637-8351-1ceb51e3bf10 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.221673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:16.279946 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.280618 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.280899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.281181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.281943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.283646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb808d9-380e-45d1-ac0d-08239288497a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.294057 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1145/2285] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:16.298240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.308869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aad11-1a51-4a1d-94e2-e39549646b3b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.313744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.314710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.315056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.315396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] PATH_INFO: `/v3/projects/a727cf4a4cbe4e579689242005ba9439/users/f17b8cd079aa41abad882d554d8b7928/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.317497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a727cf4a4cbe4e579689242005ba9439, user_id=f17b8cd079aa41abad882d554d8b7928, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.320260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.330593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1141/2286] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:40:16 2022] PUT /identity/v3/projects/a727cf4a4cbe4e579689242005ba9439/users/f17b8cd079aa41abad882d554d8b7928/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:16.342005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.342500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.342952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.374614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] MFA Rules not processed for user `f17b8cd079aa41abad882d554d8b7928`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:16.375844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:16.447924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1146/2287] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:16.458999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.461029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:16.524888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a4fa-3fc5-44ce-ad06-f6abaabb0fd4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.529327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.529973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.530249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.530523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.575755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:16.592163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.593650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.603840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1142/2288] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:26.444290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=55 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:26.598946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=8 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:34.783964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:34.808868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923d7b-5d85-43c9-a881-a2c37f2c4768 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:34.813178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:34.813684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:34.814334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:34.814334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:34.823900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:34.825329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d8335-c31f-4596-bd66-fa0a45ec300e service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:34.834757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1147/2289] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:43.858396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:43.859940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:43.937328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0818f9-9004-4c90-9759-72dd0019eb39 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:43.943175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:43.944095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.944368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.944638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] PATH_INFO: `/v3/users/d1cc70ba6f864782841e9a1f42d27148` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.945942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cc70ba6f864782841e9a1f42d27148)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:43.947939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.001090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cc70ba6f864782841e9a1f42d27148'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.001841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cc70ba6f864782841e9a1f42d27148'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.002463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cc70ba6f864782841e9a1f42d27148'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.015953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cc70ba6f864782841e9a1f42d27148'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.023863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cc70ba6f864782841e9a1f42d27148'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.037430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1143/2290] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:40:43 2022] DELETE /identity/v3/users/d1cc70ba6f864782841e9a1f42d27148 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:44.042055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:44.042576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:44.042576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:44.062842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:44.064103 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:44.129338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1148/2291] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:44.139450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:44.141153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:44.201721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b9c88-3ac9-4480-928d-8ac21dc22f07 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:44.206666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:44.207310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:44.207620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:44.207877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:44.218463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:44.220095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.232093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1144/2292] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:44.511525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:44.513314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:44.526396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6c09-e733-4969-847d-e4bf2b08a632 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:44.531479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:44.532390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:44.532667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:44.532907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] PATH_INFO: `/v3/projects/0a27dba81375476893fda0dd03c0af82` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:44.534167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a27dba81375476893fda0dd03c0af82)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:44.536077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.586014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a27dba81375476893fda0dd03c0af82', 'request_id': 'req-316e8020-8fa3-422c-b113-de3cc22d37d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.592316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a27dba81375476893fda0dd03c0af82', 'request_id': 'req-316e8020-8fa3-422c-b113-de3cc22d37d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.597868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a27dba81375476893fda0dd03c0af82', 'request_id': 'req-316e8020-8fa3-422c-b113-de3cc22d37d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.612966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] The token cache is being invalidate because project 0a27dba81375476893fda0dd03c0af82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:44.613275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.613885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.615760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1149/2293] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:40:44 2022] DELETE /identity/v3/projects/0a27dba81375476893fda0dd03c0af82 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:44.620088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:44.631200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c891d7-fa1e-43a4-9abd-e0e36a7e8d0e service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:44.660242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:44.707806 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:44.708703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:44.709014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:44.709318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] PATH_INFO: `/v3/users/4d6ae5b6c77f4096afabcd7f33dde055` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:44.710553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6ae5b6c77f4096afabcd7f33dde055)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:44.712674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.765382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6ae5b6c77f4096afabcd7f33dde055'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.766019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6ae5b6c77f4096afabcd7f33dde055'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.766621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6ae5b6c77f4096afabcd7f33dde055'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.781925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6ae5b6c77f4096afabcd7f33dde055'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.790746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6ae5b6c77f4096afabcd7f33dde055'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.811289 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1145/2294] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:40:44 2022] DELETE /identity/v3/users/4d6ae5b6c77f4096afabcd7f33dde055 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:45.177928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.181296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.196918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8020-8fa3-422c-b113-de3cc22d37d5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.209468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.211329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.282160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.283042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.283322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.283616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] PATH_INFO: `/v3/users/d4c1a33a687d4a71a2e7e9c280782598` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.285167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c1a33a687d4a71a2e7e9c280782598)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.287206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.290975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:45.322955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ffea-dedb-4e91-ac46-b195d45cc783 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.329946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.331308 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.331661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.331954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] PATH_INFO: `/v3/projects/4dfd1329dbc3401f9a404e56310b7d85` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.333346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfd1329dbc3401f9a404e56310b7d85)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.335679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.352958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c1a33a687d4a71a2e7e9c280782598'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.353530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c1a33a687d4a71a2e7e9c280782598'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.361450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c1a33a687d4a71a2e7e9c280782598'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.374438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c1a33a687d4a71a2e7e9c280782598'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.375181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-72409d68-a832-4f0b-b1ac-132fd225ce6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c1a33a687d4a71a2e7e9c280782598'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.383605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:45.388286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfd1329dbc3401f9a404e56310b7d85', 'request_id': 'req-2ebd9956-025f-4d67-86b1-7a9f3d94818a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.391010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1150/2295] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:40:45 2022] DELETE /identity/v3/users/d4c1a33a687d4a71a2e7e9c280782598 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:45.395520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.395865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.395994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfd1329dbc3401f9a404e56310b7d85', 'request_id': 'req-2ebd9956-025f-4d67-86b1-7a9f3d94818a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.396150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.402269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfd1329dbc3401f9a404e56310b7d85', 'request_id': 'req-2ebd9956-025f-4d67-86b1-7a9f3d94818a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.414132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:45.415325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.417208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] The token cache is being invalidate because project 4dfd1329dbc3401f9a404e56310b7d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:45.417503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.418113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2ebd9956-025f-4d67-86b1-7a9f3d94818a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.420251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1146/2296] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:40:45 2022] DELETE /identity/v3/projects/4dfd1329dbc3401f9a404e56310b7d85 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:45.426867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63113a4-83d1-446b-b996-36b9cd7de707 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.427222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63113a4-83d1-446b-b996-36b9cd7de707 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.427506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63113a4-83d1-446b-b996-36b9cd7de707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.447266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a63113a4-83d1-446b-b996-36b9cd7de707 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:45.448731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a63113a4-83d1-446b-b996-36b9cd7de707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.475768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1151/2297] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:45.485383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.486772 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.510918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1147/2298] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:45.519165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.519482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.519797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.538184 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:45.539358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.545391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f643-bb4d-427f-be5b-11f2b3e3b965 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.547430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1148/2299] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:45.549230 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.549882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.550195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.550442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.551398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.559611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.560213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed0327-180b-41bc-a73f-f5515c3810de None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.561373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.565293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.565954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.566230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.566501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.567211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:40:45.567508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.569214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.571472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1152/2300] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:45.584812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1149/2301] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:40:45.589185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.600246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9a346-04ca-4bbf-9674-0613c7692353 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.606554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.607752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.608376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.608725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.609524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.611582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.643110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1153/2302] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:45.644348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.655680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1323e-c280-438d-9182-f951048fe1e8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.737026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.737768 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.738105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.739040 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.739200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.741222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.773494 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1150/2303] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:40:45.777391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.783526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:45.789614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ed4d-1d38-4770-8d6a-c18becb01285 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.798161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.799159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.799841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.800466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.801768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.805079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.819383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1154/2304] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:45.824478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.834862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c85e8-b67e-4f37-8f14-9e5bd0d59132 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.843530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.844425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.844849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.845161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.845901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.847585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.859659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1151/2305] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:40:45.863672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.875799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5bca5-9085-4d58-b6df-9d85ba812656 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.882228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.883224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.883515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.883828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] PATH_INFO: `/v3/projects/2903f615bb3e4cad906a438e68d9e440/users/8a169bf6e6804e8688bf18e6be6b5d7b/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.904812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2903f615bb3e4cad906a438e68d9e440, user_id=8a169bf6e6804e8688bf18e6be6b5d7b, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.908277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7618da2-2838-43f0-9cd8-95fbe79960de admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.917135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.919616 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.932756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1155/2306] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:40:45 2022] PUT /identity/v3/projects/2903f615bb3e4cad906a438e68d9e440/users/8a169bf6e6804e8688bf18e6be6b5d7b/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:45.934163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b8d5-4e10-4193-baf3-e5a551e1aa62 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.944578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.944910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.945197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.970318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:45.974979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] MFA Rules not processed for user `8a169bf6e6804e8688bf18e6be6b5d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:45.976464 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:46.001919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:46.002787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:46.003067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:46.003350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] PATH_INFO: `/v3/projects/788fae779c8a4b5a8cfc6a1d5053346b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:46.004707 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=788fae779c8a4b5a8cfc6a1d5053346b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:46.006659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:46.050678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1156/2307] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:46.060216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788fae779c8a4b5a8cfc6a1d5053346b', 'request_id': 'req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:46.066219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:46.067854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788fae779c8a4b5a8cfc6a1d5053346b', 'request_id': 'req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:46.068420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:46.076836 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788fae779c8a4b5a8cfc6a1d5053346b', 'request_id': 'req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:46.096821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] The token cache is being invalidate because project 788fae779c8a4b5a8cfc6a1d5053346b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:46.097192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:46.098086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:46.100366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1152/2308] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:40:45 2022] DELETE /identity/v3/projects/788fae779c8a4b5a8cfc6a1d5053346b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:46.182424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071df2c-c5fc-40ec-a577-fcef8c688d62 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:46.246807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:46.247523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:46.247826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:46.248097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:46.250001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:46.257093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:46.320137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:46.321604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8105f-61d1-4e3a-bd27-5b57ce47f2d4 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:46.330524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1157/2309] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:56.093290 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:56.326441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=24 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:28.727408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:28.729611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:28.851189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a0ea-4836-4fde-83fb-a206ff0dca2b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:28.857375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:28.858404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:28.858597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:28.859043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] PATH_INFO: `/v3/users/9299dcf01b4c407286b54f9379bd71dd` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:28.863076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9299dcf01b4c407286b54f9379bd71dd)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:28.868234 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:28.944400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9299dcf01b4c407286b54f9379bd71dd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:28.945057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9299dcf01b4c407286b54f9379bd71dd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:28.945751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9299dcf01b4c407286b54f9379bd71dd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:28.973902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9299dcf01b4c407286b54f9379bd71dd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:28.985250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9299dcf01b4c407286b54f9379bd71dd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.016269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1153/2310] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:28 2022] DELETE /identity/v3/users/9299dcf01b4c407286b54f9379bd71dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:29.018321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.019172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.019795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.043305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:29.044561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.106916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1158/2311] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:29.117128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:29.118739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.186469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2f3b-731e-4af5-a25d-5345562e035b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:29.190274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:29.190928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.191242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.191555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.202905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:29.204478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24857-8587-44ca-911d-3598f74399b6 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:29.215588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1154/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:29.653829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:29.655376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.668997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc4c6b-3c3b-4c22-b37d-5aab05d0c97b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:29.675044 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:29.676139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.676469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.676734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] PATH_INFO: `/v3/projects/4859bcdae1924dd0a40f2f00e9c46a21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.678243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4859bcdae1924dd0a40f2f00e9c46a21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:29.680207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:29.740515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4859bcdae1924dd0a40f2f00e9c46a21', 'request_id': 'req-b147366a-4dda-495e-839b-07437c406e3e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.748076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4859bcdae1924dd0a40f2f00e9c46a21', 'request_id': 'req-b147366a-4dda-495e-839b-07437c406e3e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.755796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4859bcdae1924dd0a40f2f00e9c46a21', 'request_id': 'req-b147366a-4dda-495e-839b-07437c406e3e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.771657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] The token cache is being invalidate because project 4859bcdae1924dd0a40f2f00e9c46a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:29.771991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.773895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b147366a-4dda-495e-839b-07437c406e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:29.779309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1159/2313] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:29 2022] DELETE /identity/v3/projects/4859bcdae1924dd0a40f2f00e9c46a21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:29.781411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265826f6-2a33-4d91-b5a6-d4abad598024 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.782044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265826f6-2a33-4d91-b5a6-d4abad598024 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.783406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265826f6-2a33-4d91-b5a6-d4abad598024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.815003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-265826f6-2a33-4d91-b5a6-d4abad598024 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:29.817479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-265826f6-2a33-4d91-b5a6-d4abad598024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.842668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:29.873735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.874100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.874492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.893748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] MFA Rules not processed for user `0431b1f25497443ba483b3c440669080`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:29.895210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.909068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1155/2314] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:29.917424 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.917729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.918095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.943771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:29.945152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.955642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1156/2315] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:29.958814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1160/2316] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:29.958962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:29.975102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64b944-366b-44d0-a8ae-371292be1cc1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:29.980710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:29.984147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.984551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.984776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.985645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:29.985784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:29.986022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:29.987088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.987713 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.003573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e601b4-e4cc-4bdc-86d5-8cc75414b735 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.003737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1157/2317] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:30.008601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.009790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.010681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.010957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.011231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] PATH_INFO: `/v3/users/d18a3425a6b946b184ca316e540a50f3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.012483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18a3425a6b946b184ca316e540a50f3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.014460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.020617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788647c-23db-45a4-aa1a-a000384c4e90 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.029251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.030069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.030471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.030810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.031732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.035153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.046211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:30.099650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1158/2318] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:30.103824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.112299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18a3425a6b946b184ca316e540a50f3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.113449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18a3425a6b946b184ca316e540a50f3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.140694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18a3425a6b946b184ca316e540a50f3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.169154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18a3425a6b946b184ca316e540a50f3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.170613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a798f731-925f-44b9-bb81-3e52d317f408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18a3425a6b946b184ca316e540a50f3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.192667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d0e51-9f4d-4b56-b694-fa0288bc1b58 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.198252 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.199589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.199589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.199589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.200892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.202692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.206682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1161/2319] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:29 2022] DELETE /identity/v3/users/d18a3425a6b946b184ca316e540a50f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:30.215130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.217155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.219131 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.231646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1159/2320] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:30 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:30.235695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.245967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.247785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:30.249147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.251442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3478efe-2ed1-41bf-b94f-9146da426b68 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.317105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.318048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1162/2321] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:30.318175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.318412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.318694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.319462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.323958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.328171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.329606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.336098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1160/2322] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:30.340359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.351333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec159a53-c253-4278-bd6c-7adefe935c23 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.356041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.356736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.357057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.357270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.358062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.359950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.361501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:30.373130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1161/2323] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:30.377123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.388487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4f69a-122c-4bfc-84b1-cd9a9a930799 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.393343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.394292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.394573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.395146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] PATH_INFO: `/v3/projects/5b6cda0e5a7f4eeebc5ea96f41458390/users/90bebecfa8e547b2b3cde7be684538ad/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.404320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50851d6-2834-4f5d-ba0b-7e4f4dfe9e2c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.408035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.408696 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.408979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.409250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.414726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6cda0e5a7f4eeebc5ea96f41458390, user_id=90bebecfa8e547b2b3cde7be684538ad, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.419885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.427800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.430874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e528b-a511-4720-be47-06adc4d17dab service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.446757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1163/2325] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:41:30.454386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1162/2325] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:30 2022] PUT /identity/v3/projects/5b6cda0e5a7f4eeebc5ea96f41458390/users/90bebecfa8e547b2b3cde7be684538ad/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:30.462530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.463165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.463635 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.499035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] MFA Rules not processed for user `90bebecfa8e547b2b3cde7be684538ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:30.500642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.549590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:30.594960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1164/2326] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:30.607943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.610443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.701722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b7f75-9d4b-42c1-9965-e000b8d45b38 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.705604 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.706272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.707632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.708530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.719429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.721684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcc699-312c-4244-b0d2-79d15650f653 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.732769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1163/2327] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:30.748799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:30.750763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:30.859322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34abb-1bf4-4324-9945-1e647672d157 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:30.864904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:30.865806 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.866083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.866394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] PATH_INFO: `/v3/projects/47f6fb02f19f49899db23a75ea11f4ae` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.867731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f6fb02f19f49899db23a75ea11f4ae)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:30.869670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:30.926216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f6fb02f19f49899db23a75ea11f4ae', 'request_id': 'req-ad1423cd-5f37-470b-966b-53fd35211754'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.934264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f6fb02f19f49899db23a75ea11f4ae', 'request_id': 'req-ad1423cd-5f37-470b-966b-53fd35211754'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.940503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f6fb02f19f49899db23a75ea11f4ae', 'request_id': 'req-ad1423cd-5f37-470b-966b-53fd35211754'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.954392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] The token cache is being invalidate because project 47f6fb02f19f49899db23a75ea11f4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:30.954651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.955287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad1423cd-5f37-470b-966b-53fd35211754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:30.956864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1165/2328] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:30 2022] DELETE /identity/v3/projects/47f6fb02f19f49899db23a75ea11f4ae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:30.962795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:30.963293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:30.963512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:30.981605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:30.982897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.056298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1164/2329] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:31.064109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19348-615c-409b-8898-3f89a959d678 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.064659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19348-615c-409b-8898-3f89a959d678 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.064659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19348-615c-409b-8898-3f89a959d678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.093588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2da19348-615c-409b-8898-3f89a959d678 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:31.094784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2da19348-615c-409b-8898-3f89a959d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.103981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1166/2330] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:31.107874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.122380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc9b56-23c0-4c28-869a-3c73cc361f81 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.125488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.126174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.126454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.126737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.127468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:31.127804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.129756 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.142117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1165/2331] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:31.146931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da19348-615c-409b-8898-3f89a959d678 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.159416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da19348-615c-409b-8898-3f89a959d678 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.161304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.161968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.162200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.162511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.163228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.165166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.194046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1167/2332] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:31 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:31.198366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.209012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab053-ebab-4eac-9760-44186844da96 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.274431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:31.276461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.278284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.287411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.288134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.288416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.288688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.289415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.291403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.313479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1166/2333] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:31 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:31.317918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.322766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:31.328621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5483-c8b3-4695-81f5-d4f98c37f314 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.333724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.334390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.334665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.334934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.335710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.337330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.347441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1167/2334] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:31.351109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2bb2-a832-4b3d-99da-517c01b52341 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.351773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.356684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.357575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.357861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.358136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] PATH_INFO: `/v3/users/a3a5bff05b3a4990aec4e7a9670dfa91` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.359461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a5bff05b3a4990aec4e7a9670dfa91)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.361474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.361672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1101-8740-4f0e-aa3b-8d40c6e088db admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.367035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.367739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.368110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.368298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.369015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.370654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.386187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1168/2335] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:31.387764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.398430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f30d8-a4cd-480e-bed9-051a0a64291c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.403209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.404134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.404414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.404685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] PATH_INFO: `/v3/projects/2fa2c4d6423444e487d259062656129b/users/0352a80bdc174b9a9df4eca60b81eba4/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.415807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a5bff05b3a4990aec4e7a9670dfa91'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:31.416527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a5bff05b3a4990aec4e7a9670dfa91'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:31.421741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa2c4d6423444e487d259062656129b, user_id=0352a80bdc174b9a9df4eca60b81eba4, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.424149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a5bff05b3a4990aec4e7a9670dfa91'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:31.424439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed95762-e68d-423e-b893-909b21f4aff4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.438351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1169/2336] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:31 2022] PUT /identity/v3/projects/2fa2c4d6423444e487d259062656129b/users/0352a80bdc174b9a9df4eca60b81eba4/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:31.438606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a5bff05b3a4990aec4e7a9670dfa91'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:31.439388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ae988551-be4a-4ead-a9ad-13a64f8312c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a5bff05b3a4990aec4e7a9670dfa91'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:31.443485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.443835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.444114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.453885 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1168/2337] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:31 2022] DELETE /identity/v3/users/a3a5bff05b3a4990aec4e7a9670dfa91 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:31.459245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.459558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.459852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.469426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:31.470657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.476987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:31.478181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.545393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1170/2338] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:31.549916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1169/2339] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:31.559628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.561293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.562163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:31.563588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:31.622875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a8e63-c4a7-49a8-9093-0bc050876f0f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.626410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.626863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c7a1d-73b6-4d00-9043-4d700058f1a3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:31.627055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.627334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.627643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.630680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:31.631332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:31.631636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:31.631909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:31.637550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.639041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.641647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:31.643266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:31.648896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:31.649877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1171/2340] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:41:31.657121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1170/2341] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:32.024582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:32.026115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:32.045820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca474c-e621-4538-a2ed-0104998c96b9 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:32.051280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:32.053116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:32.053390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:32.053706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] PATH_INFO: `/v3/projects/c2dc0b933d9e48e9af5bd1c1171fbd24` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:32.055167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dc0b933d9e48e9af5bd1c1171fbd24)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:32.064340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:32.110356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:32.127187 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dc0b933d9e48e9af5bd1c1171fbd24', 'request_id': 'req-514a9e32-d308-486a-bc32-ea0b068f48b1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.134832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dc0b933d9e48e9af5bd1c1171fbd24', 'request_id': 'req-514a9e32-d308-486a-bc32-ea0b068f48b1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.141833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dc0b933d9e48e9af5bd1c1171fbd24', 'request_id': 'req-514a9e32-d308-486a-bc32-ea0b068f48b1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.162970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] The token cache is being invalidate because project c2dc0b933d9e48e9af5bd1c1171fbd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:32.163683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.164865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.170537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1172/2342] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:32 2022] DELETE /identity/v3/projects/c2dc0b933d9e48e9af5bd1c1171fbd24 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:32.171501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:32.197129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d109-c90f-4de9-9dfb-1803e7927570 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:32.297380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:32.298472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:32.298838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:32.299473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] PATH_INFO: `/v3/users/f17b8cd079aa41abad882d554d8b7928` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:32.301266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17b8cd079aa41abad882d554d8b7928)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:32.304198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:32.392147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17b8cd079aa41abad882d554d8b7928'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.394529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17b8cd079aa41abad882d554d8b7928'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.428860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17b8cd079aa41abad882d554d8b7928'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.460246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17b8cd079aa41abad882d554d8b7928'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.462807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-499c8fc3-9b2e-4a5e-9b79-3224abff7e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17b8cd079aa41abad882d554d8b7928'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:32.495088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1171/2343] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:32 2022] DELETE /identity/v3/users/f17b8cd079aa41abad882d554d8b7928 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:33.124900 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.126474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:33.154493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9e32-d308-486a-bc32-ea0b068f48b1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.225190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.226099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.226376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.226651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] PATH_INFO: `/v3/projects/a727cf4a4cbe4e579689242005ba9439` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.228904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a727cf4a4cbe4e579689242005ba9439)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.230892 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.331787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a727cf4a4cbe4e579689242005ba9439', 'request_id': 'req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:33.338645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a727cf4a4cbe4e579689242005ba9439', 'request_id': 'req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:33.347209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a727cf4a4cbe4e579689242005ba9439', 'request_id': 'req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:33.365357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] The token cache is being invalidate because project a727cf4a4cbe4e579689242005ba9439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:33.365750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:33.366807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b8cb0017-fcb9-4c90-8c91-c4ba236e256b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:33.368929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1173/2344] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:33 2022] DELETE /identity/v3/projects/a727cf4a4cbe4e579689242005ba9439 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:33.375501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.376163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.376163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.401468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:33.403362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:33.513956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1172/2345] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:33.523780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.524121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.524336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.544875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:33.546109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:33.555272 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1174/2346] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:33.560001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.577923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc507-9409-404b-828e-3b7c0595e983 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.588773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.590046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.590700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.591369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.593989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:33.594643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.597807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.631436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1173/2347] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:33.633172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.657859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e76e9-7ef6-4e58-a53b-2cb1f44a6dec None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.665438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.667107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.667464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.667886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.668796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.671165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.715575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1175/2348] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:33 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:33.720072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.728318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:33.733530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8dae4-7155-4b2d-85a3-1a16f4168b4e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.823066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.823855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.824348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.824561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.825447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.828651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.858821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1174/2349] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:33 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:33.862951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.884171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03b3a-d692-46fb-9095-ae7962514db6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.889091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.889750 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.890032 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.890327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.891117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.892871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.908192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1176/2350] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:33.909242 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.919805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c9262-6844-4469-90f2-6a0cac12df72 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.926484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.928060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.928347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.928624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:33.929829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:33.932802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540789b-cf5d-4dce-95db-9fa0eb08add2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:33.952512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1175/2351] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:33.953607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:33.971742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ada0-18c1-49c1-b55b-12dca9b8e386 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:33.985542 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:33.986733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:33.987017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:33.987293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] PATH_INFO: `/v3/projects/b5767a0ca6f34cd38e547b2f697b3aac/users/df5b49b9a23b4f929dc43dc6ed14ac7a/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.005150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:34.029106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5767a0ca6f34cd38e547b2f697b3aac, user_id=df5b49b9a23b4f929dc43dc6ed14ac7a, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.033153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.063148 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1177/2352] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:33 2022] PUT /identity/v3/projects/b5767a0ca6f34cd38e547b2f697b3aac/users/df5b49b9a23b4f929dc43dc6ed14ac7a/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:34.082169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.082586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.082867 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.139396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] MFA Rules not processed for user `df5b49b9a23b4f929dc43dc6ed14ac7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:34.141080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.234006 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.235796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.334171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1176/2353] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:34.339020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.456183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0bdb-99e2-4eb5-89a0-37e19984d353 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.461539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.462274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.462554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.462825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.463558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.465803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.493676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943c610-00a1-4b7d-95cf-e5ba23db083f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.497473 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:34.511748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.515523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1177/2354] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:34 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:34.518858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.520574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.521745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.522646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] PATH_INFO: `/v3/users/90bebecfa8e547b2b3cde7be684538ad` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.525337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bebecfa8e547b2b3cde7be684538ad)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.529705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.615395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bebecfa8e547b2b3cde7be684538ad'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:34.617220 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bebecfa8e547b2b3cde7be684538ad'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:34.618468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bebecfa8e547b2b3cde7be684538ad'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:34.643841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bebecfa8e547b2b3cde7be684538ad'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:34.645346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e463c3-58af-48f6-bdc3-30ea20c3f487 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.658826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2b7e7b6c-a309-409d-b0da-72398703c0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bebecfa8e547b2b3cde7be684538ad'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:34.669883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.670656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.671639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.671921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.672636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.674793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.694503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1178/2355] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:34 2022] DELETE /identity/v3/users/90bebecfa8e547b2b3cde7be684538ad => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:34.697828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.699209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.699639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.708214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1178/2356] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:34 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:34.709488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.711672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.722264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:34.724674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.730813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1fed-0fac-47cc-af68-8e25d42a4940 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.813445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1179/2357] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:34.819395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.820435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.820791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.821156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.822414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.823770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.824438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.825477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.838451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:34.839819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1179/2358] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:34.844330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.864914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639706-e3c6-4412-bf36-449f50e83d1b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.876101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.878887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.879876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.880547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] PATH_INFO: `/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed/users/d8392f40366841aa8b9eac304e3a57fb/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.913113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e6cb7f18e1407db5f65efdb81f37ed, user_id=d8392f40366841aa8b9eac304e3a57fb, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.916783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:34.937218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1180/2359] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:34 2022] PUT /identity/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed/users/d8392f40366841aa8b9eac304e3a57fb/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:34.941797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.947196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72d4f1-b7ae-4738-bad0-ef2f30997fbe None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.017060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.017734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.018012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.018287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.044619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bd4d4-fc07-4602-aa91-96b164dc1264 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.051325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.052967 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.053470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.053966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.054945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.059827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.062369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:35.116428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1181/2360] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:35.120354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.125594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.128300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1598-89cb-42d3-b34f-4d590dd4b5a4 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.136281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8605-3f81-462c-b51b-0ba1da4a9656 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.142193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.143269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.143570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.143860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] PATH_INFO: `/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed/users/d8392f40366841aa8b9eac304e3a57fb/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.145639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1180/2361] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:35.147240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e6cb7f18e1407db5f65efdb81f37ed, user_id=d8392f40366841aa8b9eac304e3a57fb, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.150852 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.164802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1182/2362] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:35 2022] PUT /identity/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed/users/d8392f40366841aa8b9eac304e3a57fb/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:35.178684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.179178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.179761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.229053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] MFA Rules not processed for user `d8392f40366841aa8b9eac304e3a57fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:35.230598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:35.322727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:35.330080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1181/2363] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:35.343326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.345240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:35.469167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f92d-0940-4378-b309-3eebc369e582 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.476795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.477475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.477760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.478091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.493798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.507089 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.531096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1183/2364] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:35.916839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.918443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.083305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aab0da-19cf-4d18-9c06-67c547d350f7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.089303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.091719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.092023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.092300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] PATH_INFO: `/v3/projects/5b6cda0e5a7f4eeebc5ea96f41458390` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.093943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6cda0e5a7f4eeebc5ea96f41458390)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.097057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.131993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.145605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983deb9a-c925-4ba3-aa95-63ea49d5ea85 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.153644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8392f40366841aa8b9eac304e3a57fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.154773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.155430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.155976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.157244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:36.157758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.160606 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.183525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1184/2365] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:36.185237 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.197936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95b78-75f9-4056-958b-892082a88dab tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.207029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6cda0e5a7f4eeebc5ea96f41458390', 'request_id': 'req-1156d9b2-438e-476b-a8b1-2ce080e6a21d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.214309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6cda0e5a7f4eeebc5ea96f41458390', 'request_id': 'req-1156d9b2-438e-476b-a8b1-2ce080e6a21d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.222095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6cda0e5a7f4eeebc5ea96f41458390', 'request_id': 'req-1156d9b2-438e-476b-a8b1-2ce080e6a21d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.244103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] The token cache is being invalidate because project 5b6cda0e5a7f4eeebc5ea96f41458390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:36.244394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.245054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1156d9b2-438e-476b-a8b1-2ce080e6a21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.248108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1182/2366] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:35 2022] DELETE /identity/v3/projects/5b6cda0e5a7f4eeebc5ea96f41458390 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:36.252712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ae15-4756-4fe0-8c15-df4d281bdc43 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.253830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ae15-4756-4fe0-8c15-df4d281bdc43 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.254207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ae15-4756-4fe0-8c15-df4d281bdc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.283333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8392f40366841aa8b9eac304e3a57fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.284111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d4a7ae15-4756-4fe0-8c15-df4d281bdc43 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:36.285596 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.285722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.286100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4a7ae15-4756-4fe0-8c15-df4d281bdc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.286216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.287071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.290347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.363907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1185/2367] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/projects => generated 355 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:36.367482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.370293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.436534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1183/2368] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:36.439075 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.439367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.439859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.489069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:36.491008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.515205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:36.524911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b094-e370-46f9-9bef-18b3d0033785 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.537733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8392f40366841aa8b9eac304e3a57fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.538695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.538810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.539031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.539868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:36.540181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.541820 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.543031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:36.569944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1186/2369] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:36.615001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1184/2370] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:36.616444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.624813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.633454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8372c-b0a6-4d86-b52f-413921bf6560 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.642663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.643373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a09c9-cdd1-4829-a58d-f320ccd724f8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.643489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.644049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.644224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.645216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:36.645582 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.648898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.650203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8392f40366841aa8b9eac304e3a57fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.651376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.651735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.655201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] PATH_INFO: `/v3/projects/86370cac10a14bf6833d0239004683b9` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.656779 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86370cac10a14bf6833d0239004683b9)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.658924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.670822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1187/2371] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:41:36.672245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.686599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99510b-5b53-43a0-9aa9-6b9e345e5c1f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.693449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.694119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.694889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.694889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.695466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.697309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.723496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86370cac10a14bf6833d0239004683b9', 'request_id': 'req-8906ffb6-0bd6-4f47-b2c1-eca06579a649'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.744294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86370cac10a14bf6833d0239004683b9', 'request_id': 'req-8906ffb6-0bd6-4f47-b2c1-eca06579a649'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.758093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1188/2372] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:36.758822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86370cac10a14bf6833d0239004683b9', 'request_id': 'req-8906ffb6-0bd6-4f47-b2c1-eca06579a649'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.763733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.798361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] The token cache is being invalidate because project 86370cac10a14bf6833d0239004683b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:36.798975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.800071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.818943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1185/2373] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:36 2022] DELETE /identity/v3/projects/86370cac10a14bf6833d0239004683b9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:36.916030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaceb7f-fbdb-4d7a-8bd9-b6655a318291 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.921704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.922611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.923476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.923476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.923971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.926213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.951616 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1189/2374] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:36.955393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.957403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.040979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906ffb6-0bd6-4f47-b2c1-eca06579a649 tempest-VolumeQuotaClassesTest-142015393 tempest-VolumeQuotaClassesTest-142015393-project-admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.047908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.048610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.048943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.049642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.050550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.052305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.066216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1186/2375] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:37.072034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.086308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a7bf-cd7d-49b3-9cb8-db88fff92e56 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.091983 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.092823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.093139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.093412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.094155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.095854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.098169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.101033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.109529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1190/2376] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:37.115804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.128225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca0b55-b5b4-4b4f-9caa-8a3402b28ba7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.131087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6314-e230-4172-b876-453a6b16edbb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.133378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.134924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.135300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.135611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] PATH_INFO: `/v3/users/df5b49b9a23b4f929dc43dc6ed14ac7a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.136880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5b49b9a23b4f929dc43dc6ed14ac7a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.138143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.139095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.140245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.140245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.140458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] PATH_INFO: `/v3/projects/ffa93879e60e470185e8dd71efaaf1a9/users/f39e076a9e6b401db6de9a2846519591/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.175578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa93879e60e470185e8dd71efaaf1a9, user_id=f39e076a9e6b401db6de9a2846519591, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.194100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447db1b0-1794-4de2-a66b-46aeb28512b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.225132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:37.227987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5b49b9a23b4f929dc43dc6ed14ac7a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:37.228881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5b49b9a23b4f929dc43dc6ed14ac7a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:37.229573 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5b49b9a23b4f929dc43dc6ed14ac7a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:37.234746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1191/2377] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:37 2022] PUT /identity/v3/projects/ffa93879e60e470185e8dd71efaaf1a9/users/f39e076a9e6b401db6de9a2846519591/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:37.240951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.241546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.242440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.254733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5b49b9a23b4f929dc43dc6ed14ac7a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:37.266683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-18968cd9-5337-425c-85cc-56ff63412c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5b49b9a23b4f929dc43dc6ed14ac7a'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:37.291854 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:37.293110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.294674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1187/2378] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:37 2022] DELETE /identity/v3/users/df5b49b9a23b4f929dc43dc6ed14ac7a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:37.307080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.307902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.308517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.332553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:37.335304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.382172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1192/2379] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:37.389423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.391770 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.414125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:37.430802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1188/2380] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:37.440425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.447628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.473850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2daf8d-0702-4e5f-9af4-e2cda1f617d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.478093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.478764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.479188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.479474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.491558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.493817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0f85c-c1c7-47f9-8a01-660ee98a31fc service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.507629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1193/2381] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:37.549641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7142d-bc74-481a-8ca3-8fa54c4c1937 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.558469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.563749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.564105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.564387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.585611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.586121 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.586223 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.596672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.598266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.612327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1189/2382] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:41:37.624500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] MFA Rules not processed for user `0352a80bdc174b9a9df4eca60b81eba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:37.625771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.707896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1194/2383] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:37.712468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.714229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.729458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6465f-be0b-49cf-a1bb-e8280c2bcb11 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.735447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.736240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.737391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.737391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.737606 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.739528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.774415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1190/2384] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:37.775695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.789339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c55bb8-eea9-4cd5-9095-6ee351ba9ff2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.864602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.865366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.865962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.866202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.867297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.869481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.918567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1195/2385] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:37.922406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.939365 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126f555-d435-4141-9ab1-4c050638132b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.952941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.953715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.954024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.954333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.955224 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.957122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.985686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1191/2386] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:37.987188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.002774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110bb4-4c2e-4ce7-9cae-bd89b1f3ffa0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.008254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.009165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.009446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.009718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] PATH_INFO: `/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca/users/fe9fab80fae0469e870d9440f88065d0/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.027583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afaf41d5b6e49c6a6dc781b1ffaadca, user_id=fe9fab80fae0469e870d9440f88065d0, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.030935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.051530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1196/2387] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:37 2022] PUT /identity/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca/users/fe9fab80fae0469e870d9440f88065d0/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:38.055955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.073620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1375c5-8856-4c20-9eee-90e53b0aa8b4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.116469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:38.148204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.150275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:38.154962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.155928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.156681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.157195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.158105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.159986 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.175689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1192/2388] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:38.179756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f67c3-2d2f-4ad4-8265-d0cbaf160ce4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.183430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.188063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.191893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.192350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.192920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] PATH_INFO: `/v3/projects/b5767a0ca6f34cd38e547b2f697b3aac` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.195000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5767a0ca6f34cd38e547b2f697b3aac)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.198586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.203768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:38.205745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b109-2cb9-4549-b214-9d961918c079 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.226329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.227455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.228028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.228415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] PATH_INFO: `/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca/users/fe9fab80fae0469e870d9440f88065d0/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.231874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afaf41d5b6e49c6a6dc781b1ffaadca, user_id=fe9fab80fae0469e870d9440f88065d0, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.235288 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.249381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1193/2389] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:38 2022] PUT /identity/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca/users/fe9fab80fae0469e870d9440f88065d0/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:38.289564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5767a0ca6f34cd38e547b2f697b3aac', 'request_id': 'req-d6448b9f-c3f9-44ef-b320-b2319186be20'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.299266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5767a0ca6f34cd38e547b2f697b3aac', 'request_id': 'req-d6448b9f-c3f9-44ef-b320-b2319186be20'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.309361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5767a0ca6f34cd38e547b2f697b3aac', 'request_id': 'req-d6448b9f-c3f9-44ef-b320-b2319186be20'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.333986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] The token cache is being invalidate because project b5767a0ca6f34cd38e547b2f697b3aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:38.334280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.334985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d6448b9f-c3f9-44ef-b320-b2319186be20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.337010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1197/2390] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:38 2022] DELETE /identity/v3/projects/b5767a0ca6f34cd38e547b2f697b3aac => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:38.341062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.343715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:38.447964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1c269-2473-4772-bc6c-d43b17c746ca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.540732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.542223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.542657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.544004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] PATH_INFO: `/v3/users/d8392f40366841aa8b9eac304e3a57fb` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.546314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8392f40366841aa8b9eac304e3a57fb)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.548620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.649561 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8392f40366841aa8b9eac304e3a57fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.653451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8392f40366841aa8b9eac304e3a57fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.654165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8392f40366841aa8b9eac304e3a57fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.677925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:38.681210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8392f40366841aa8b9eac304e3a57fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.696539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8392f40366841aa8b9eac304e3a57fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:38.715125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1194/2391] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:38 2022] DELETE /identity/v3/users/d8392f40366841aa8b9eac304e3a57fb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:38.914902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.915438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.915773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.986520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] MFA Rules not processed for user `f39e076a9e6b401db6de9a2846519591`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:38.989419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:39.095862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1198/2392] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:39.107437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.109113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:39.206598 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de3a8-ffde-4ef0-b043-ed2290c51054 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.211620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.212784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.213600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.213891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.236219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.238110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:39.240397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.243947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499242c-caca-4ae2-ab23-053f0fe98ac2 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.255964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1195/2393] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:39.346238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71109f-b9bd-496a-8db2-698035918513 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.351710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.353275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.353626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.354564 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] PATH_INFO: `/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.356083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e6cb7f18e1407db5f65efdb81f37ed)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.359040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.399831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:39.438247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'request_id': 'req-38a1c31c-0709-40d3-9212-6b6c76ee06f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:39.447401 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'request_id': 'req-38a1c31c-0709-40d3-9212-6b6c76ee06f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:39.455903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e6cb7f18e1407db5f65efdb81f37ed', 'request_id': 'req-38a1c31c-0709-40d3-9212-6b6c76ee06f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:39.474093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] The token cache is being invalidate because project a5e6cb7f18e1407db5f65efdb81f37ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:39.474404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:39.475283 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a1c31c-0709-40d3-9212-6b6c76ee06f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:39.477557 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1199/2394] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:39 2022] DELETE /identity/v3/projects/a5e6cb7f18e1407db5f65efdb81f37ed => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:39.482550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.483106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.483106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.503490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:39.505048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:39.588765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1196/2395] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:39.591360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.591930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.592521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.633757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:39.636654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:39.677762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1200/2396] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:39.679792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.693798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41f25-6f12-49ce-94a9-f813a18c531e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.700064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.700950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.701400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.703103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.704130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:39.704640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.706532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.731702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.738053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1197/2397] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:39.745913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42a88-cb93-4109-a903-c550f76b85f3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.756253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.757229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.758017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.758305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.759724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.761991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.813615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1201/2398] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:39 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:39.818035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.829925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f694-67d4-47f8-b66c-831cf5b0cdf5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.895658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.896502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.896846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.897190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.898596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.901003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.922457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:39.929663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1198/2399] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:39 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:39.933650 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:39.959743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201098-c373-4dba-a386-bbe8cde966ca admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:39.977197 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:39.978141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:39.978427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:39.978701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:39.979685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:39.981377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:39.997353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1202/2400] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:39.998590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.009591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0528fc-f736-4d47-8191-0c1ec7249073 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.016160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.017417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.017417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.017614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.018651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.021117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15a146-076e-4b72-849f-aeec08b0def2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.034431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1199/2401] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:40.039681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.051576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb64c4-a5ec-4ea0-944f-60dcb388a311 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.056408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.057386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.057969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.058110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] PATH_INFO: `/v3/projects/67dae5a696984e1ba11773baae46e70d/users/8c771ccc985642caa5e68d513a6f4a15/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.094191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dae5a696984e1ba11773baae46e70d, user_id=8c771ccc985642caa5e68d513a6f4a15, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.098800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.116339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1203/2402] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:40 2022] PUT /identity/v3/projects/67dae5a696984e1ba11773baae46e70d/users/8c771ccc985642caa5e68d513a6f4a15/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:40.126575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.126776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.126992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.179466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] MFA Rules not processed for user `8c771ccc985642caa5e68d513a6f4a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:40.180504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:40.308039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1200/2403] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:40.309890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.409942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359554f2-8358-4a6b-a372-9f06029bc56c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.414845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.415623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.415909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.416181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.416895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.418876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.452391 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1204/2404] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:40 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:40.455719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.473515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644a26b-edac-42dc-a8a2-eb8e2339cc7b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.559218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.560490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.560490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.560695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.561630 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.563420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.595027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1201/2405] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:40 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:40.596837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.609284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c36ae-a53c-425a-816e-1f88f7f7c792 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.618692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.619394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.620570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.620570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.621009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.624011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.641893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1205/2406] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:40.643722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.657948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f6946-e33b-4001-89aa-1cc796777190 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.666136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.666765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.666879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.667383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] PATH_INFO: `/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd/users/d1173d660fd84e13909cfca0aec81b23/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.688613 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=35126b0b2bd64e9da3ba87f9b966e0fd, user_id=d1173d660fd84e13909cfca0aec81b23, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.691405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.713291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1202/2407] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:40 2022] PUT /identity/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd/users/d1173d660fd84e13909cfca0aec81b23/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:40.718252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.729389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b2d1-3217-4aaf-950b-5c5b9086d585 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.760438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:40.846830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.847662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.848336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.850016 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.850862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.853179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74d40a-c44a-4e93-90fa-27153682c243 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.876825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1206/2408] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:40.882546 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.901303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44308-76df-4a77-a9d5-96508bd7fdbf admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.907597 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.908834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.909119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.909401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] PATH_INFO: `/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd/users/d1173d660fd84e13909cfca0aec81b23/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.912510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35126b0b2bd64e9da3ba87f9b966e0fd, user_id=d1173d660fd84e13909cfca0aec81b23, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.916053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.946331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.946794 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.947018 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.947478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1203/2409] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:40 2022] PUT /identity/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd/users/d1173d660fd84e13909cfca0aec81b23/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:40.998420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] MFA Rules not processed for user `d1173d660fd84e13909cfca0aec81b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:40.999711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:41.139025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1207/2410] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:41.148304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.150058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:41.217709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:41.289634 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0b40-cdc1-4342-aabf-6f633cf47977 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.308565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.312783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.313375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.313874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.334507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.335992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.362696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1204/2411] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:41.512002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.525810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327c61b-b356-4d06-9ee0-ac550cdec54a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.536919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.538011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.538127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.538381 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.682032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.684452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1cb75-e938-4f76-864d-b3b23ea7a8e0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.700432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1208/2412] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:42.388532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.554522 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d9a2-e579-4ca7-a163-b7598ee622ae service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.565481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.566428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.566740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.567127 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] PATH_INFO: `/v3/users/8c771ccc985642caa5e68d513a6f4a15` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.571161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c771ccc985642caa5e68d513a6f4a15)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.573358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.748449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c771ccc985642caa5e68d513a6f4a15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:42.761379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c771ccc985642caa5e68d513a6f4a15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:42.764213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c771ccc985642caa5e68d513a6f4a15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:42.816592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c771ccc985642caa5e68d513a6f4a15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:42.839560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c771ccc985642caa5e68d513a6f4a15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:42.873345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1205/2413] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:42 2022] DELETE /identity/v3/users/8c771ccc985642caa5e68d513a6f4a15 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:42.877894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.878603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.880491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.961442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:42.963093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:43.056415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:43.119687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1209/2414] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:43.201111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.202859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:43.380785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.382469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:43.397073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8c182-a699-4efd-b14f-da069994fbed admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.415142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.419869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.420202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.420479 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.466688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:43.478405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.481763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e50e7-aa71-47f3-b757-c1cb0643ea3c service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.537636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1206/2415] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:41:43.800762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e903-6ee3-4126-9977-02ae53f52947 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.825189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.830260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.830590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.830824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.838872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:43.891014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.892698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.922177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1210/2416] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:44.208018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.208629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.209046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.262353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] MFA Rules not processed for user `f39e076a9e6b401db6de9a2846519591`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:44.267000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.387965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1207/2417] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:44.921858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:44.923581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.954225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff1ae-a2a2-4f7c-ade8-549e9bc2e557 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:44.960826 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:44.962146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.962731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.963217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] PATH_INFO: `/v3/projects/67dae5a696984e1ba11773baae46e70d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.965428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dae5a696984e1ba11773baae46e70d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:44.968171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.142657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dae5a696984e1ba11773baae46e70d', 'request_id': 'req-82d476a6-32f8-415e-8ca9-e8205720a8be'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.167298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dae5a696984e1ba11773baae46e70d', 'request_id': 'req-82d476a6-32f8-415e-8ca9-e8205720a8be'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.191521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dae5a696984e1ba11773baae46e70d', 'request_id': 'req-82d476a6-32f8-415e-8ca9-e8205720a8be'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.236835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] The token cache is being invalidate because project 67dae5a696984e1ba11773baae46e70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:45.240236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.243454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-82d476a6-32f8-415e-8ca9-e8205720a8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.248947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1211/2418] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:44 2022] DELETE /identity/v3/projects/67dae5a696984e1ba11773baae46e70d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:45.254501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.294215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85529c2-3251-4b4e-a363-870ada321b96 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.490983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.491929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.492214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.492641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] PATH_INFO: `/v3/users/d1173d660fd84e13909cfca0aec81b23` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.495189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1173d660fd84e13909cfca0aec81b23)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.506916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.634447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1173d660fd84e13909cfca0aec81b23'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.635985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1173d660fd84e13909cfca0aec81b23'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.636149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1173d660fd84e13909cfca0aec81b23'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.672203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1173d660fd84e13909cfca0aec81b23'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.694619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1173d660fd84e13909cfca0aec81b23'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.730391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1208/2419] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:45 2022] DELETE /identity/v3/users/d1173d660fd84e13909cfca0aec81b23 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:46.190920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.191619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.192165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.238786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] MFA Rules not processed for user `fe9fab80fae0469e870d9440f88065d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:46.240717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.273263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:46.340206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1212/2420] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:46.354390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.357473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.387309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:46.439583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561c7f-7746-4498-9375-7fc36ee54e16 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.444151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.445907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.445907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.445907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.447397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.619455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.621227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7143c-8db5-46ab-9113-9320dfaf8ff2 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.648275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1209/2421] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:46.768549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.770514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.833098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.833893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.834364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.902148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52a91-396d-4710-9b82-86eec7a6d6fd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.915690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.920201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.920584 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.922152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] PATH_INFO: `/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.927375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35126b0b2bd64e9da3ba87f9b966e0fd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.931682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.961214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:46.965488 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.036995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35126b0b2bd64e9da3ba87f9b966e0fd', 'request_id': 'req-394b88c7-9b73-4157-a60f-8c18bf2edaf5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.051120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35126b0b2bd64e9da3ba87f9b966e0fd', 'request_id': 'req-394b88c7-9b73-4157-a60f-8c18bf2edaf5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.066118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35126b0b2bd64e9da3ba87f9b966e0fd', 'request_id': 'req-394b88c7-9b73-4157-a60f-8c18bf2edaf5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.090714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] The token cache is being invalidate because project 35126b0b2bd64e9da3ba87f9b966e0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:47.091566 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.092397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-394b88c7-9b73-4157-a60f-8c18bf2edaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.094644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1213/2422] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:46 2022] DELETE /identity/v3/projects/35126b0b2bd64e9da3ba87f9b966e0fd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:47.104692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d835de-a53f-415f-b0cb-d58a478db0ec None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.105147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d835de-a53f-415f-b0cb-d58a478db0ec None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.105522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d835de-a53f-415f-b0cb-d58a478db0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.132367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1210/2423] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:47.134602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f6d835de-a53f-415f-b0cb-d58a478db0ec None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:47.136048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6d835de-a53f-415f-b0cb-d58a478db0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.204345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.205946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.240927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:47.254222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:47.267392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1214/2424] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:47.275958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.276249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.276708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.306350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:47.308140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.322776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1215/2425] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:47.326903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.346115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda4c7d-ff38-428d-88ba-98644039fe25 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.349020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d37e-4bae-4d19-8c9b-07bf39b1bc93 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.355894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.357025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.358001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.358456 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.359373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:47.359878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.365420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.387206 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1216/2426] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:47.392341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.410901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53956fcd-49fc-4a3a-8a6a-2909a16907b3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.429014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.429694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.430558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.430837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.431519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.433779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.437692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.438786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.439128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.439428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.468154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1217/2427] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:47.472334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.531094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.533373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.545939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1211/2428] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:41:47.571153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277513-9940-452c-850b-4de16556c247 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.584977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.585667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.585954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.586231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.586943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.588989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.626117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1218/2429] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/users => generated 281 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:47.632840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.655976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d164-2216-4afa-8a2a-6c32d227116a service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.662369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.663102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.663459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.664588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.665353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.667247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.681357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1212/2430] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:47.685897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.717554 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce86ab-3797-44c3-b2c3-20f2d01b4389 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.737383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.738029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.738323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.739895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.742487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.745113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833d88-99f7-4972-8025-42b4067e8a19 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.762974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1219/2431] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:47.766922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.781053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b738-3970-409e-9ed0-4e162d212edd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.792311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.793647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.793953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.794213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] PATH_INFO: `/v3/projects/ce9a93eb36994b80bf9ab90a7aa74546/users/4eeeb72a1ea847798cbf12ed8a60263b/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.813650 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9a93eb36994b80bf9ab90a7aa74546, user_id=4eeeb72a1ea847798cbf12ed8a60263b, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.816504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.844028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1213/2432] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:47 2022] PUT /identity/v3/projects/ce9a93eb36994b80bf9ab90a7aa74546/users/4eeeb72a1ea847798cbf12ed8a60263b/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:47.848740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.849031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.849307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.887138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] MFA Rules not processed for user `4eeeb72a1ea847798cbf12ed8a60263b`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:47.887705 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:48.005910 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1220/2433] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:48.043091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.045116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:48.076438 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:48.126174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0f8b-ed15-41be-ac06-3860799ca2f1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.131516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.132433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.132829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.133178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.145014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.147111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3261-22e6-413f-b8e8-58d9e9c89c23 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.159581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1214/2434] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:48.177660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.222327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:48.352212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe5c1b-e904-403f-8d09-17b6f571157c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.390466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.390466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.390466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.390466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] PATH_INFO: `/v3/users/4eeeb72a1ea847798cbf12ed8a60263b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.396800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eeeb72a1ea847798cbf12ed8a60263b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.406111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.584638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eeeb72a1ea847798cbf12ed8a60263b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:48.585871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eeeb72a1ea847798cbf12ed8a60263b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:48.604385 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eeeb72a1ea847798cbf12ed8a60263b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:48.650332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eeeb72a1ea847798cbf12ed8a60263b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:48.652498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eeeb72a1ea847798cbf12ed8a60263b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:48.687200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1221/2435] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:48 2022] DELETE /identity/v3/users/4eeeb72a1ea847798cbf12ed8a60263b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:48.692993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.695270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.695990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.731311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:48.734017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:48.905420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1215/2436] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:48.917888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.920164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:49.071354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de279-8196-437d-8e1c-2b96235eb4b5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:49.076768 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:49.077613 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:49.079123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:49.079123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:49.091845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:49.093528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408340-6576-4cc6-9916-de75239e8918 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:49.116874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1222/2437] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:49.687746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:49.689414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:49.715359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a91fb-f5c5-4302-8c07-bccd058d8e2b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:49.758669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:49.759638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:49.765760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:49.766273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] PATH_INFO: `/v3/projects/ce9a93eb36994b80bf9ab90a7aa74546` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:49.767955 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9a93eb36994b80bf9ab90a7aa74546)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:49.769933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:49.879631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9a93eb36994b80bf9ab90a7aa74546', 'request_id': 'req-e264c563-04e0-4020-b16a-8605e9572e06'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:49.903487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9a93eb36994b80bf9ab90a7aa74546', 'request_id': 'req-e264c563-04e0-4020-b16a-8605e9572e06'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:49.918189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9a93eb36994b80bf9ab90a7aa74546', 'request_id': 'req-e264c563-04e0-4020-b16a-8605e9572e06'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:49.954015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] The token cache is being invalidate because project ce9a93eb36994b80bf9ab90a7aa74546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:49.954392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:49.956055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e264c563-04e0-4020-b16a-8605e9572e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:49.961095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1216/2438] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:49 2022] DELETE /identity/v3/projects/ce9a93eb36994b80bf9ab90a7aa74546 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:49.964921 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:49.967122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:49.967821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.008397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:50.010640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:50.093692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:50.177957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1223/2439] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:50.183487 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.186686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.186994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.223577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:50.225244 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:50.242121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1217/2440] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:50.243848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.255428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879bf62-172e-473b-be8d-61dc935adab1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.281986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.282922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.283228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.283507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.284311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:50.284623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:50.286907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:50.312746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1224/2441] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:50.317183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.335045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b19880-a0b1-4862-b4a1-68b0065244aa None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.353372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.355073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.355073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.355702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.356792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:50.361865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:50.429787 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1218/2442] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:41:50 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:50.430882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.443750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76727-2da6-4bfd-83e9-1e44d2df0cd5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.609133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.610663 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.611752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.611752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.612995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:50.618659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:50.684907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1225/2443] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:41:50 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:50.686683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.764976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e997-d0c2-4b7a-84cc-abcedf6faf6a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.788517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.789868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.790068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.790441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.791291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:50.793131 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:50.825842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1219/2444] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:50.830221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.854152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c2db3-0367-4368-b2e6-b13415ad3f7b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.865063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.867075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.867599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.871344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.872272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:50.876412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436161e7-02bd-4676-830d-9a55406b3676 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:50.921173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1226/2445] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:50.925455 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:50.952741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad5d6-0f86-4c3c-a939-9ea8a7273415 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:50.978742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:50.980466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:50.980850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:50.981239 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] PATH_INFO: `/v3/projects/c1f2f503ef674a4b97f848b69f8b63c5/users/8d9bf2dcfce24386a1aaf9709d88da45/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:50.987489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:51.078973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f2f503ef674a4b97f848b69f8b63c5, user_id=8d9bf2dcfce24386a1aaf9709d88da45, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:51.083413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:51.105745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1220/2446] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:41:50 2022] PUT /identity/v3/projects/c1f2f503ef674a4b97f848b69f8b63c5/users/8d9bf2dcfce24386a1aaf9709d88da45/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:51.111194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:51.112165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:51.112659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:51.168791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:51.173346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:51.509210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1227/2447] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:51.517474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:51.519678 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:51.654397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4708248-2af8-4308-8411-e0515816963c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:51.661280 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:51.662193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:51.662645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:51.663076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:51.686789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:51.688483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea19d0-d503-4fde-a9dc-4b8e565cd5a3 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:51.700946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1221/2448] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:52.564209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:52.566154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:52.590233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0253-c89d-4590-89c2-20b5644cefc3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:52.606240 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:52.607273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:52.608447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:52.608593 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] PATH_INFO: `/v3/users/8a169bf6e6804e8688bf18e6be6b5d7b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:52.614116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a169bf6e6804e8688bf18e6be6b5d7b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:52.617038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:52.731856 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:52.744824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a169bf6e6804e8688bf18e6be6b5d7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.747221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a169bf6e6804e8688bf18e6be6b5d7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.764580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a169bf6e6804e8688bf18e6be6b5d7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.802721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a169bf6e6804e8688bf18e6be6b5d7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.804876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a169bf6e6804e8688bf18e6be6b5d7b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.829694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1228/2449] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:41:52 2022] DELETE /identity/v3/users/8a169bf6e6804e8688bf18e6be6b5d7b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:52.835192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:52.835192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:52.836152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:52.872874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:52.874298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:52.978580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1222/2450] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:53.015816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.017755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.113333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1796e-a519-436f-93d4-2efc42ddec55 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.165322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.166027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.166389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.166767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.199771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.199771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182fa6a-9077-4b2e-a70c-206e48fbdc2b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.226414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1229/2451] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:53.758049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.759871 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.773478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f121-4ac0-4776-8c10-821908eb4719 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.780084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.781294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.781784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.782532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] PATH_INFO: `/v3/projects/2903f615bb3e4cad906a438e68d9e440` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.791005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2903f615bb3e4cad906a438e68d9e440)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.794351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.883397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2903f615bb3e4cad906a438e68d9e440', 'request_id': 'req-03c2f1b7-2689-472f-adfe-c9b3e91eb186'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.893936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2903f615bb3e4cad906a438e68d9e440', 'request_id': 'req-03c2f1b7-2689-472f-adfe-c9b3e91eb186'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.905046 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2903f615bb3e4cad906a438e68d9e440', 'request_id': 'req-03c2f1b7-2689-472f-adfe-c9b3e91eb186'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.930777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] The token cache is being invalidate because project 2903f615bb3e4cad906a438e68d9e440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:53.931823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.933293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.949719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1223/2452] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:41:53 2022] DELETE /identity/v3/projects/2903f615bb3e4cad906a438e68d9e440 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:00.549785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:00.550476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:00.552030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:00.629482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] MFA Rules not processed for user `8d9bf2dcfce24386a1aaf9709d88da45`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:00.631792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:00.735779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1230/2453] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:42:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:00.741199 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:00.750162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:00.798971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:00.922805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-2689-472f-adfe-c9b3e91eb186 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:00.930804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:00.931792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:00.932237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:00.932654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:00.933994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:00.936329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:00.985080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1224/2454] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:42:00 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:00.989081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.018382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a629a5-b5c8-4c7f-a0ff-3d916515d95e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.118901 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:01.136704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.138574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.139517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.139953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.140792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.143707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.182409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1231/2455] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:42:00 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:01.185620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.220800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d32ee4-6c6a-4e9c-9942-4725e73384e8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.233302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.234393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.234829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.236081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.237490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.244537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.289343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1225/2456] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:01.293422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.314777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59a399-1bd7-45fb-9307-e567003ad90a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.329878 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.331167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.331452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.331777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] PATH_INFO: `/v3/projects/0ac11ef573454889b1fb222d2cfa7a35/users/7492848bf86644b0805a2e67f80bce9e/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.379986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac11ef573454889b1fb222d2cfa7a35, user_id=7492848bf86644b0805a2e67f80bce9e, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.382837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.414070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1232/2457] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:42:01 2022] PUT /identity/v3/projects/0ac11ef573454889b1fb222d2cfa7a35/users/7492848bf86644b0805a2e67f80bce9e/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:01.414970 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.428990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb385-c7e5-4194-bec4-8f7b3a1f0967 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.562150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.562976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.563740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.564095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.564954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.566755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ec30-7313-4f18-a250-01e8f77a6066 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.583364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1226/2458] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:42:01.589048 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.601785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa236ec-a595-4067-a55a-e3108c705b14 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.607423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.608652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.608991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.609322 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] PATH_INFO: `/v3/projects/0ac11ef573454889b1fb222d2cfa7a35/users/7492848bf86644b0805a2e67f80bce9e/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.611944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac11ef573454889b1fb222d2cfa7a35, user_id=7492848bf86644b0805a2e67f80bce9e, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.615451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b863a2-00a9-4578-ad7c-37a863a9adad admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.636643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1233/2459] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:42:01 2022] PUT /identity/v3/projects/0ac11ef573454889b1fb222d2cfa7a35/users/7492848bf86644b0805a2e67f80bce9e/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:03.693317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:03.694149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:03.694149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:03.743295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] MFA Rules not processed for user `0352a80bdc174b9a9df4eca60b81eba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:03.750123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:03.854879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1227/2460] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:42:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:09.980002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3a50-a001-436b-a3ca-44b7c89543ba None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.980710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3a50-a001-436b-a3ca-44b7c89543ba None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.980710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3a50-a001-436b-a3ca-44b7c89543ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:10.014896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e93f3a50-a001-436b-a3ca-44b7c89543ba None None] MFA Rules not processed for user `7492848bf86644b0805a2e67f80bce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:10.016328 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e93f3a50-a001-436b-a3ca-44b7c89543ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:10.118067 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1234/2461] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:42:10.134336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:10.135942 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:10.168493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:10.252529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfcc55-f401-4834-b970-bd71b58570df None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:10.259896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:10.260587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:10.260861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:10.261136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:10.330866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:10.332587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:10.345846 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1228/2462] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:42:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:42:11.042757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30312-c2b1-4ad4-a687-1757d455bf57 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:11.043757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30312-c2b1-4ad4-a687-1757d455bf57 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:11.043757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30312-c2b1-4ad4-a687-1757d455bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:11.093229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6ae30312-c2b1-4ad4-a687-1757d455bf57 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:11.096721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6ae30312-c2b1-4ad4-a687-1757d455bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:11.269802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1235/2463] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:42:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:11.292195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:11.297813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:11.444560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b848cd-fb40-466a-8f1b-53d637ce2a08 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:11.451388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:11.452680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:11.453144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:11.453482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:11.463976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:11.465780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0366-ebf7-4401-b907-264e32cf145b service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:11.477732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1229/2464] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:12.660823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be09e-5397-46e9-9fe0-89de19df1f9c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:12.661277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be09e-5397-46e9-9fe0-89de19df1f9c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:12.661695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be09e-5397-46e9-9fe0-89de19df1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:12.688973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b70be09e-5397-46e9-9fe0-89de19df1f9c None None] MFA Rules not processed for user `8d9bf2dcfce24386a1aaf9709d88da45`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:12.691248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b70be09e-5397-46e9-9fe0-89de19df1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:12.709262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1236/2465] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:42:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:21.472974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:22.684629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:51.448794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:51.449464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:51.449464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:51.472958 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] MFA Rules not processed for user `f39e076a9e6b401db6de9a2846519591`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:51.475004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:51.553359 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1230/2466] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:42:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:43:01.545381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=25 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:03.265576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:03.266612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:03.267281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:03.290945 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] MFA Rules not processed for user `805854e5ce2e412fb9420afd63f73ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:03.292637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:03.359903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1237/2467] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:04.501281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:04.503646 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:04.526547 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:04.528997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:04.577593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356de99-29b2-40f6-8f31-e672b9ee4e27 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:04.582000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:04.582654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:04.583118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:04.583402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:04.585625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:04.606317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:04.609797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:04.610365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c91ab2-3b64-4a60-aea3-5ffcc4bfd5f3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:04.614674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:04.615472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:04.615795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:04.616072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:04.617929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:04.622731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1231/2468] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:04.632859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:04.634334 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530eaa2-ae54-4568-951b-e8bc3113d1cc service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:04.647628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1238/2469] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:43:11.734927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.746536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5c56-bb5f-4cdd-9677-1b69f2c528c6 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.753429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.754084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.754367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.754637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.757011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:11.820446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.822105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.832160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1232/2470] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:13.680585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:13.681260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:13.681260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:13.704958 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:13.706590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:13.719474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1239/2471] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:13.770194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:13.788211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85b35-7009-431c-9cb5-b959b931df64 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:13.793702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:13.794535 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:13.794809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:13.795158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:13.804560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:13.806165 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:13.815271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1233/2472] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:43:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:43:23.697451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=54 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:23.811881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=60 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:23.956072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:23.969771 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423f9d-80b5-4697-88c4-af2c133d56c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:23.981802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:23.982488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:23.982829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:23.983040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:23.990659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:24.103934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:24.108716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:24.126379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1240/2473] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:26.099265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:26.125965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa57b9-20a7-4b84-85c4-fe3c5d4c15ac service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:26.136111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:26.141222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:26.141710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:26.142270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:26.167485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:26.170769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:26.198434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1234/2474] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:31.685591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:31.696220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc59e51-b018-4603-b3b2-188d9a083cf4 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:31.702752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:31.704142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.704660 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.705132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.707516 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:31.735058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:31.736677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:31.738465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:31.747990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1241/2475] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:31.751614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:31.754323 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf68c9-fa4f-452d-a454-9324fa7b3fff service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:31.762598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf496b-c0a4-4599-9324-33481d61cb59 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:31.763410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:31.764626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.765670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.766581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.767937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:31.769191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.769687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.770122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.782570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:31.782824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:31.784452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:31.785194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:31.800743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1235/2476] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:43:31.801321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1242/2477] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:32.675893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:32.677605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:32.701022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2204-909e-4f04-9b9e-c5a2fd87f6ef service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:32.710382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:32.710700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:32.710898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:32.711157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:32.714452 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:32.731445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:32.733183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6100a6-63b7-4e8b-aa97-13fc8f8c468e service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:32.748084 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1236/2478] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:35.980760 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:35.995104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138919-4aee-4d17-a399-207e641c363e service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.001831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.002963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.003509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.004049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.006872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.024962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.028198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e83f-ebcd-40ce-a769-93b075494c84 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.042063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1243/2479] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:36.167784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.168364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.168478 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.170379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1237/2480] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:43:36.179476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ceef2-035e-4b1d-b78f-5089c5883ef6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.179789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ceef2-035e-4b1d-b78f-5089c5883ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.180071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ceef2-035e-4b1d-b78f-5089c5883ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.225363 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-902ceef2-035e-4b1d-b78f-5089c5883ef6 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.226580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-902ceef2-035e-4b1d-b78f-5089c5883ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.237081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1244/2481] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.255074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.256849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.335030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c17ad-5e66-4eb7-be50-55b663162d73 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.339718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.340402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.340677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.340943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.353267 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.355458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc051f-263d-497c-9ec0-1d9c72d1248f service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.370352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1238/2482] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:36.446796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021f50-ba69-4ba1-bf4e-da8531d6668f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.447777 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021f50-ba69-4ba1-bf4e-da8531d6668f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.448039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021f50-ba69-4ba1-bf4e-da8531d6668f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.449708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1245/2483] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:43:36.458878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec85a-8823-4352-82fa-5e2f0a44a482 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.459166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec85a-8823-4352-82fa-5e2f0a44a482 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.459409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec85a-8823-4352-82fa-5e2f0a44a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.482330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3daec85a-8823-4352-82fa-5e2f0a44a482 None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.483591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3daec85a-8823-4352-82fa-5e2f0a44a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.491273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1239/2484] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.504083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021f50-ba69-4ba1-bf4e-da8531d6668f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.517373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021f50-ba69-4ba1-bf4e-da8531d6668f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.522781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.523416 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.523729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.524173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.533449 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.535050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2f5c5-4cbd-4663-98e5-6ea175593faa service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.544284 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1246/2485] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:36.645254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8679-115b-4f76-baf4-b9b324108ec9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.645531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8679-115b-4f76-baf4-b9b324108ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.645973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8679-115b-4f76-baf4-b9b324108ec9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.647364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1240/2486] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:43:36.653714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.654013 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.654296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.679026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.680472 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.693940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1247/2487] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:43:36.706960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8679-115b-4f76-baf4-b9b324108ec9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.720709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8679-115b-4f76-baf4-b9b324108ec9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.725225 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.725914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.726196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.726472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.743789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.743789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7522-df24-447b-8d5b-a5d837857842 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.752782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1241/2488] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:36.820285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.822110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.928076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277e4c5-100a-4557-b5a6-d56823aecb0a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.936139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.937031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.937382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.937719 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.939628 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.952135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.953732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.964509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1248/2489] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:43.798529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948a6f-cf2f-445c-a583-d99fdef2b0f4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:43.799047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948a6f-cf2f-445c-a583-d99fdef2b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:43.799373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948a6f-cf2f-445c-a583-d99fdef2b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:43.824532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dc948a6f-cf2f-445c-a583-d99fdef2b0f4 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:43.826206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc948a6f-cf2f-445c-a583-d99fdef2b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:43.836746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1242/2490] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:43:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:43.851853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:43.859437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:43.869531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa039-7a83-427f-b13e-218b305b6d9f service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:43.876844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:43.877693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:43.878272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:43.878577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:43.892079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:43.894383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:43.907232 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1249/2491] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:43:50.409671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d415b-8e86-4bf2-898a-87ad7d80845d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:50.409671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d415b-8e86-4bf2-898a-87ad7d80845d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:50.410809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d415b-8e86-4bf2-898a-87ad7d80845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:50.430310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-434d415b-8e86-4bf2-898a-87ad7d80845d None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:50.432484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-434d415b-8e86-4bf2-898a-87ad7d80845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:50.440203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1243/2492] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:43:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:50.455874 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:50.469863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270fba-347b-4c85-853c-ba47e52800c9 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:50.476162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:50.476162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:50.477021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:50.477574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:50.488657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:50.490267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:50.502132 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1250/2493] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:43:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:00.064747 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e91d-b47b-4ee5-9a13-2598fb6beed6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:00.065347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e91d-b47b-4ee5-9a13-2598fb6beed6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:00.065347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e91d-b47b-4ee5-9a13-2598fb6beed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:00.072354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=60 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:00.088527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3648e91d-b47b-4ee5-9a13-2598fb6beed6 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:00.089717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3648e91d-b47b-4ee5-9a13-2598fb6beed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:00.097989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1244/2494] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:44:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:00.112226 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:00.123010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282acb-c13f-4c6f-810e-1915ab274dfc service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:00.128652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:00.129296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:00.129576 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:00.129832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:00.140188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:00.144221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091905b1-a2da-4485-b31d-b1e24c6245ca service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:00.157477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1251/2495] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:44:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:02.387528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.388147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.388147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.389648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1245/2496] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:44:02.405075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.405672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.405672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.469299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] MFA Rules not processed for user `ce69c247da4f47a3baaf1126891a70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:02.470932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:02.491389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1252/2497] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:02.500638 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:02.503123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:02.514117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:02.534128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691c8b1-c84e-4a23-ac3b-be561054c8c0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:02.548372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:02.549316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.549816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.550254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.576178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:02.577918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:02.607038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1253/2498] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:02.636987 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2be9-b74c-472a-a7f6-bdd0b81f7123 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:02.642971 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:02.644755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.644755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.644755 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] PATH_INFO: `/v3/users/f39e076a9e6b401db6de9a2846519591` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.647097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39e076a9e6b401db6de9a2846519591)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:02.649822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:02.709795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39e076a9e6b401db6de9a2846519591'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:02.710544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39e076a9e6b401db6de9a2846519591'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:02.711564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39e076a9e6b401db6de9a2846519591'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:02.727527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39e076a9e6b401db6de9a2846519591'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:02.738294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c8d0023-ccb1-463e-bdbb-b2d45c20484f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39e076a9e6b401db6de9a2846519591'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:02.756338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1246/2499] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:44:02 2022] DELETE /identity/v3/users/f39e076a9e6b401db6de9a2846519591 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:02.949541 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:02.976795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82d4b-ad4d-4a91-8ca6-9bbfd4663ff4 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.056998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.060366 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.061522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.062248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] PATH_INFO: `/v3/projects/ffa93879e60e470185e8dd71efaaf1a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.065562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa93879e60e470185e8dd71efaaf1a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.070797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.128130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa93879e60e470185e8dd71efaaf1a9', 'request_id': 'req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:03.135767 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa93879e60e470185e8dd71efaaf1a9', 'request_id': 'req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:03.143051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa93879e60e470185e8dd71efaaf1a9', 'request_id': 'req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:03.158102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] The token cache is being invalidate because project ffa93879e60e470185e8dd71efaaf1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:03.158335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:03.159020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d2d8d78-9616-4e1f-bb6a-2f4c16a72285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:03.160698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1254/2500] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:44:02 2022] DELETE /identity/v3/projects/ffa93879e60e470185e8dd71efaaf1a9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:03.165785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.166332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.166686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.185790 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:03.187115 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:03.249579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1247/2501] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:03.258244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.258531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.258804 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.284069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:03.285435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:03.294790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1255/2502] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:03.299932 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.310474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e41b-caa9-46af-bf02-aed33e72f59b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.315423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.316186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.316397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.316662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.317401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:03.317718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.319371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.332315 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1248/2503] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:03.336670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.347515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be794b-6445-4823-adb5-7fb3c861b6fa None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.359029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.359695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.359695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.360343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.360740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.362680 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.386244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:03.402224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1256/2504] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:44:03 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:03.407085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.412966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:03.423068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9378ab-fc65-4faa-bb42-c7bd25cf1493 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.500230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.500914 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.501197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.501473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.502222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.504242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.534872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1249/2505] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:44:03 2022] POST /identity/v3/users => generated 281 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:03.539916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.553791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfaa-7017-47bf-828e-7a865638bf3c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.560528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.561512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.561652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.561908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.562714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.564724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.582795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1257/2506] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:03.586680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.597330 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c7c04-11cc-4bb4-8652-b1fd383c91a0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.606543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.607279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.608117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.611662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.613674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.616222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf25805-7e8f-404a-b915-2ffb699dfbd5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.639590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1250/2507] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:03.641583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.654157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9e3d-7a71-4656-9577-befbd2ebccbf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:03.659509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:03.660447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.660731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.661008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] PATH_INFO: `/v3/projects/8f9cfb022f344b86a6e90354d529f00c/users/4d8c085446324c3ebc7e67d787697ab8/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.678151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9cfb022f344b86a6e90354d529f00c, user_id=4d8c085446324c3ebc7e67d787697ab8, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:03.680884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:03.698714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1258/2508] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:44:03 2022] PUT /identity/v3/projects/8f9cfb022f344b86a6e90354d529f00c/users/4d8c085446324c3ebc7e67d787697ab8/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:03.708079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:03.708373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:03.708705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:03.765397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] MFA Rules not processed for user `4d8c085446324c3ebc7e67d787697ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:03.767387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:03.859684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1251/2509] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:03.871784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:03.873611 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:04.017192 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585811-e931-4938-b32d-fe994db6efdb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:04.021612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:04.022331 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:04.022619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:04.022898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:04.033743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:04.035266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:04.058553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1259/2510] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:13.856291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:14.045789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:24.040793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:24.042221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:24.167015 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65cd76-4653-4d31-8409-e4a1471ae1cc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:24.180007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:24.181055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:24.181839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:24.182124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:24.184246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:24.202784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:24.204651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea0eda-450f-44ba-ae20-226d144d3769 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:24.220847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1252/2511] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:30.420800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:30.422426 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:30.434661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579973-5c51-428b-acca-77bf60e44181 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:30.440886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:30.441548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:30.441837 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:30.442281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:30.444335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:30.511685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:30.514155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:30.526243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1260/2512] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:33.219210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:33.219805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:33.219805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:33.239019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:33.240250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:33.303896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1253/2513] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:44:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:33.330061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:33.331732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:33.416459 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e67ca-5d86-4127-af09-c16426467678 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:33.422903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:33.424518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:33.424803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:33.425077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:33.438409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:33.439892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:33.449755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1261/2514] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:43.297038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=59 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:43.446407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=60 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.677337 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.678901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.760409 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba80c-16c9-4b7a-8435-0a46221bea50 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.764191 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.764847 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.765117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.765386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.767468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.850444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.851950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.862570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1254/2515] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:56.402261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.404119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.420380 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aee69-0734-40f8-8fa6-97459244ca67 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.426653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.427507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.427828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.428105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] PATH_INFO: `/v3/users/805854e5ce2e412fb9420afd63f73ee6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.429454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=805854e5ce2e412fb9420afd63f73ee6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.431423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.494980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805854e5ce2e412fb9420afd63f73ee6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.496066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805854e5ce2e412fb9420afd63f73ee6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.506721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805854e5ce2e412fb9420afd63f73ee6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.520375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805854e5ce2e412fb9420afd63f73ee6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.521120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a6b843d-7546-4b04-b612-bab30cf7e1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805854e5ce2e412fb9420afd63f73ee6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.535249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1262/2516] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:44:56 2022] DELETE /identity/v3/users/805854e5ce2e412fb9420afd63f73ee6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:56.733899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.746889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253d547-6787-40d6-b02c-694a7e73b3b0 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.825908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.826995 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.827213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.827569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] PATH_INFO: `/v3/projects/72bda4cbb07a43688506e01d06ba89c2` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.829931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bda4cbb07a43688506e01d06ba89c2)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.831959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.894394 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bda4cbb07a43688506e01d06ba89c2', 'request_id': 'req-71be428e-4492-445e-82a4-719eb5998a40'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.901543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:56.901543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bda4cbb07a43688506e01d06ba89c2', 'request_id': 'req-71be428e-4492-445e-82a4-719eb5998a40'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.908838 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bda4cbb07a43688506e01d06ba89c2', 'request_id': 'req-71be428e-4492-445e-82a4-719eb5998a40'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.922925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] The token cache is being invalidate because project 72bda4cbb07a43688506e01d06ba89c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:56.923208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.923896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-71be428e-4492-445e-82a4-719eb5998a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.925491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1255/2517] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:44:56 2022] DELETE /identity/v3/projects/72bda4cbb07a43688506e01d06ba89c2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:56.930702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.930995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.931297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.951162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:56.952411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.022413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1263/2518] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:57.031014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.031254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.031722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.053517 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:57.054807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.064117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1256/2519] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:57.068925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.085954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db396-03d8-4699-8dd5-53e1dccb0efc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.094360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.095282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.095839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.096306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.097637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:57.098184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.101315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.121754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1264/2520] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:57.128462 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.138662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9fc7f-9a25-45bd-a084-8e4ac06ec506 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.145679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.146656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.146935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.147210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.148082 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.150514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.198405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1257/2521] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:57.203502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.215407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ab4f-0a8e-4ca7-90d9-e20981c4b566 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.280343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.280931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.281214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.281483 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.282306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.284224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.291313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:57.308383 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1265/2522] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:57.313988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.324967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebf298-7d89-45f5-afb2-bac2d5dac2d9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.329752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.330427 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.330720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.331035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.331802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.333471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.344345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1258/2523] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:57.349646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.360438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff4171-d92b-467e-acc3-8bfe51cbd304 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.365536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.366207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.366486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.366780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.367484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.369141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86980-f786-45c9-9d15-633042ba3c67 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.381062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1266/2524] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:57.384645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.395276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a077332-dabc-404c-978b-6903d73de1fb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.400271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.401195 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.401493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.401771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] PATH_INFO: `/v3/projects/f152e1cb11494f97965a1ca25ebeaa7c/users/be2a215867c9457fade99dba251e3cc7/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.418039 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f152e1cb11494f97965a1ca25ebeaa7c, user_id=be2a215867c9457fade99dba251e3cc7, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.420785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.437672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1259/2525] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:44:57 2022] PUT /identity/v3/projects/f152e1cb11494f97965a1ca25ebeaa7c/users/be2a215867c9457fade99dba251e3cc7/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:57.448578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.449118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.449211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.477586 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] MFA Rules not processed for user `be2a215867c9457fade99dba251e3cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:57.478827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.548773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1267/2526] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:57.560331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.562098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.621742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97d1d-d1ea-4725-a4e7-ea92989cb884 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.626495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.627152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.627428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.627812 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.637927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.639408 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077faef7-9c71-4d53-96df-d35663736ef7 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.650641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1260/2527] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:06.856903 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.933150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa627ee-1b86-4dce-a225-527d89adf314 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.938049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.939079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.939530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.939835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] PATH_INFO: `/v3/users/be2a215867c9457fade99dba251e3cc7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.941245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2a215867c9457fade99dba251e3cc7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.943184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.995107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2a215867c9457fade99dba251e3cc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.995769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2a215867c9457fade99dba251e3cc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.003859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2a215867c9457fade99dba251e3cc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.014052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.016659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2a215867c9457fade99dba251e3cc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.017379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2a215867c9457fade99dba251e3cc7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.033631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1268/2528] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:45:06 2022] DELETE /identity/v3/users/be2a215867c9457fade99dba251e3cc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:07.038881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.039391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.039516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.059581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.060938 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.131963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1261/2529] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:07.142665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.144193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.210646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee4985-6c5b-410d-bc5e-56eb1441a465 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.215270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.215985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.216296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.216571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.226938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.228427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e50c28-3d7a-4966-bb26-b6a9badb4a45 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.239056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1269/2530] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:07.427631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.429123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.443068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd3bc-36b2-4ec2-9ff2-f78b86e19498 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.448368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.449292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.449549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.449851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] PATH_INFO: `/v3/users/4d8c085446324c3ebc7e67d787697ab8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.451119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8c085446324c3ebc7e67d787697ab8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.453415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.458833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.515674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8c085446324c3ebc7e67d787697ab8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.516407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8c085446324c3ebc7e67d787697ab8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.517156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8c085446324c3ebc7e67d787697ab8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.531582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8c085446324c3ebc7e67d787697ab8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.540565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8c085446324c3ebc7e67d787697ab8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.558969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1262/2531] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:45:07 2022] DELETE /identity/v3/users/4d8c085446324c3ebc7e67d787697ab8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:07.565928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.566422 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.566803 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.569110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.571217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.594355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.596922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.667645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d017e-68ab-498e-9a1e-f355f10b34d4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.673215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.674520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.674862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.675146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] PATH_INFO: `/v3/projects/f152e1cb11494f97965a1ca25ebeaa7c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.676860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f152e1cb11494f97965a1ca25ebeaa7c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.678934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1270/2532] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:07.679520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.685497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.686956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.730327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f152e1cb11494f97965a1ca25ebeaa7c', 'request_id': 'req-c6627b5e-f080-48aa-bee4-ad78fcb667d1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.736982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f152e1cb11494f97965a1ca25ebeaa7c', 'request_id': 'req-c6627b5e-f080-48aa-bee4-ad78fcb667d1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.743321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f152e1cb11494f97965a1ca25ebeaa7c', 'request_id': 'req-c6627b5e-f080-48aa-bee4-ad78fcb667d1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.758864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcabbb-7aeb-46a5-84a8-5541c13c09be None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.759134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] The token cache is being invalidate because project f152e1cb11494f97965a1ca25ebeaa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:07.759261 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.759931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c6627b5e-f080-48aa-bee4-ad78fcb667d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.761939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1263/2533] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:45:07 2022] DELETE /identity/v3/projects/f152e1cb11494f97965a1ca25ebeaa7c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:07.767524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1545fa6-db64-4ae5-b678-aee94a9a0f75 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.767524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1545fa6-db64-4ae5-b678-aee94a9a0f75 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.767961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1545fa6-db64-4ae5-b678-aee94a9a0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.792355 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d1545fa6-db64-4ae5-b678-aee94a9a0f75 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.793568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d1545fa6-db64-4ae5-b678-aee94a9a0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.803062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.812665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.819195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.820011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.820556 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.820846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.823235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.862114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1264/2534] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:07.871733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.872110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.872469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.896433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.897648 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.903811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.905783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.907068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1265/2535] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:07.911178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.917795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1271/2536] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:07.920350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c073c7-c40b-42af-ad51-e78ac2712097 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.925695 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.926491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.926829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.927108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.927881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:07.928186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.929840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.946451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1266/2537] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:45:07.953045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.964153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d8fc5-308f-4f84-a4b4-4de033559b19 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.971199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.971925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.972246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.972524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.973233 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.975182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.008062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1272/2538] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:08.009497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.025116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea13e-302c-49cb-b23c-a216358c230f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.101085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.101997 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.102168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.102366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.102988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.105024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.127580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1267/2539] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:45:08 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:08.131998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.143886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1197-1fa5-4075-a7b9-ee1565aad7bb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.150185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.150880 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.151155 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.151450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.152212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.153841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.166129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1273/2540] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:08.170000 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.181345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721be19c-7dca-41f0-b615-c91cca0e24c6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.186294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.186953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.187237 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.187510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.188863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.190656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.203864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1268/2541] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:08.208409 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.220119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.223168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.224130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4d58-58dc-4b80-a731-c1de3d30fc96 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.239839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.240825 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.241227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.241513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] PATH_INFO: `/v3/projects/d6fb41c547884511893b768b833f4e90/users/ab469b18ce0444d9884cdddc34ef7247/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.244303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a542fa-2250-44cc-8d55-c3e7eec67619 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.254680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.256319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.256728 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.257147 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] PATH_INFO: `/v3/projects/8f9cfb022f344b86a6e90354d529f00c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.258929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9cfb022f344b86a6e90354d529f00c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.264919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.265244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fb41c547884511893b768b833f4e90, user_id=ab469b18ce0444d9884cdddc34ef7247, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.265499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aee52-5b36-47c1-bd5f-3ffb0f0d9ae9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.281122 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1274/2542] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:45:08 2022] PUT /identity/v3/projects/d6fb41c547884511893b768b833f4e90/users/ab469b18ce0444d9884cdddc34ef7247/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:08.286127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8564-670c-46e0-b644-88ee88688d97 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.286412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8564-670c-46e0-b644-88ee88688d97 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.286685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8564-670c-46e0-b644-88ee88688d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.305918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1a4b8564-670c-46e0-b644-88ee88688d97 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:08.307167 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1a4b8564-670c-46e0-b644-88ee88688d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.317565 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9cfb022f344b86a6e90354d529f00c', 'request_id': 'req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.324724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9cfb022f344b86a6e90354d529f00c', 'request_id': 'req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.331241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9cfb022f344b86a6e90354d529f00c', 'request_id': 'req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.335831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:08.349700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] The token cache is being invalidate because project 8f9cfb022f344b86a6e90354d529f00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:08.349988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.350688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.352361 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1269/2543] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:45:08 2022] DELETE /identity/v3/projects/8f9cfb022f344b86a6e90354d529f00c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:08.373872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1275/2544] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:08.384271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.385825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.452446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eeddc-d1ff-413f-afed-8c5a94a5faca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.456964 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.457643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.457953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.458221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.469552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.471104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.482194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1270/2545] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:12.837497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:12.837991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:12.838460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:12.887295 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] MFA Rules not processed for user `ab469b18ce0444d9884cdddc34ef7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:12.888810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:12.925811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:12.969695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1276/2546] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:12.976783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:12.978429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:12.994993 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3b8-39e4-4906-98ef-15f79aaa1521 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.011360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.012141 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.012483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.012819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.013738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.015736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.049791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1271/2547] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:45:12 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:13.055252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.069532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc875-d91e-4e31-b752-85ceb1a673a1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.170406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.171117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.171397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.171720 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.172435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.174569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.203904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1277/2548] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:45:13 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:13.208574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.220389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013fa9-4327-4059-a0d4-07a302829c7f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.225924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.227142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.227752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.228215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.229341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.231309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.247062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1272/2549] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:13.253332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.265369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ec01-44fb-4527-8cc6-9539b0bd5cc8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.271792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.272828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.273180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.273525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] PATH_INFO: `/v3/projects/0e46482975b945498c56fdcdaaa07671/users/24c47fc09165477fac60d14b0e5ba66c/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.292462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e46482975b945498c56fdcdaaa07671, user_id=24c47fc09165477fac60d14b0e5ba66c, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.295402 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.314224 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1278/2550] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:45:13 2022] PUT /identity/v3/projects/0e46482975b945498c56fdcdaaa07671/users/24c47fc09165477fac60d14b0e5ba66c/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:13.318689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.329423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2204-9682-4d8f-bf47-67ffdb1de92c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.400824 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.401589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.401927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.402262 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.403104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.405228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.416469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1273/2551] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:13.421010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.432244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d0e7-7a6b-4cd7-85e5-cabde0c8aab6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.437014 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.437948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.438228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.438817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] PATH_INFO: `/v3/projects/0e46482975b945498c56fdcdaaa07671/users/24c47fc09165477fac60d14b0e5ba66c/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.441309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e46482975b945498c56fdcdaaa07671, user_id=24c47fc09165477fac60d14b0e5ba66c, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.444049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153404c-0cea-49e5-ab06-e9525f32496c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.455553 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1279/2552] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:45:13 2022] PUT /identity/v3/projects/0e46482975b945498c56fdcdaaa07671/users/24c47fc09165477fac60d14b0e5ba66c/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:16.448706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.450735 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:16.563988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:16.590724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d6149-1d28-40e7-b949-16e675878132 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.717879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.718774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.719060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.719338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.728600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:16.948437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.950164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.997941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1274/2553] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:18.986998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc55e2-8484-4fd6-b06a-900ca8cda7e6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.987510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc55e2-8484-4fd6-b06a-900ca8cda7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.987694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc55e2-8484-4fd6-b06a-900ca8cda7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.037023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-91cc55e2-8484-4fd6-b06a-900ca8cda7e6 None None] MFA Rules not processed for user `24c47fc09165477fac60d14b0e5ba66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:19.038976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-91cc55e2-8484-4fd6-b06a-900ca8cda7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:19.150934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1280/2554] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:19.174257 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.176686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:19.193560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a5fe-745a-4fb6-af38-d2a5de58b799 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.199969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.200661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.201484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.201484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.283718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.285534 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192b8ca-eaff-470b-8598-bb5c17b5e041 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.296154 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1275/2555] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:29.153031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:29.291477 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:44.420858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:44.421465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:44.421465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:44.441766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] MFA Rules not processed for user `ab469b18ce0444d9884cdddc34ef7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:44.443022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:44.453841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1281/2556] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:45.884905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df65a7-69bf-49e0-b6bc-afa2bd9d0387 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:45.885532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df65a7-69bf-49e0-b6bc-afa2bd9d0387 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:45.885532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df65a7-69bf-49e0-b6bc-afa2bd9d0387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:45.906057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c9df65a7-69bf-49e0-b6bc-afa2bd9d0387 None None] MFA Rules not processed for user `0431b1f25497443ba483b3c440669080`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:45.907358 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c9df65a7-69bf-49e0-b6bc-afa2bd9d0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:45.915702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1276/2557] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:45:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:52.590510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:52.620530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b7d6-0682-41c2-bbf3-638ab6a9d752 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:52.630213 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:52.631011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:52.631387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:52.631785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:52.634748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:52.660243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:52.662961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:52.682291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1282/2558] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:45:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:55.899274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:02.677280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=9 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:03.236445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:03.237201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:03.237201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:03.256146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] MFA Rules not processed for user `e811736979c44b02b14fecb74c6bd7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:03.257378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:03.315949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1277/2559] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:05.013143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:05.015255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:05.097357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca20e9-f03a-4da8-b1be-391a283f0dd5 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:05.101293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:05.101969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.102255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.102536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.114746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:05.116340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48958-676b-4b25-b26c-0040cc6953d4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:05.137076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1283/2560] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:13.308676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=25 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:15.122193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=26 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:52.014898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.016326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.100706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817194b-0431-4b17-89b3-3699fa40e233 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.107518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.108193 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.108463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.108741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.110748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.128381 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.130050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e5d01-92a1-4045-88a1-86e5ef3496e0 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.142657 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1278/2561] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:53.477370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9fbe-859a-484e-8389-5bb05bf31d69 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.478015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9fbe-859a-484e-8389-5bb05bf31d69 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.478015 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9fbe-859a-484e-8389-5bb05bf31d69 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.479314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1284/2562] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:53.485649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b17c-b610-4632-9814-805392115b43 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.486160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b17c-b610-4632-9814-805392115b43 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.486160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b17c-b610-4632-9814-805392115b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.506706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2a49b17c-b610-4632-9814-805392115b43 None None] MFA Rules not processed for user `33e60332dbea4c4e9e6884f5effd0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:53.508024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2a49b17c-b610-4632-9814-805392115b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.514982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1279/2563] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:53.528329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9fbe-859a-484e-8389-5bb05bf31d69 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.541269 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9fbe-859a-484e-8389-5bb05bf31d69 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.544913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.545574 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.545954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.546264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.554591 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.556092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a646045-d0f3-4d04-a403-fcff9fda71ce service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.564465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1285/2564] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:46:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:53.649036 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbf7b-48c3-46a1-b665-6d7405eeca7b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.649273 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbf7b-48c3-46a1-b665-6d7405eeca7b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.649583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbf7b-48c3-46a1-b665-6d7405eeca7b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.650953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1280/2565] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:53.657120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.657432 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.657700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.680168 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:53.681360 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.695239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1286/2566] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:53.707400 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebbf7b-48c3-46a1-b665-6d7405eeca7b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.719842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebbf7b-48c3-46a1-b665-6d7405eeca7b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.723726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.724433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.724885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.725260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.736749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.738294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.750378 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1281/2567] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:03.673862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=9 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:03.745282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=41 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:10.327316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.339506 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123988a5-8a85-4384-8cd2-126e6312b640 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:10.346678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:10.347714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:10.348130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:10.348517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.352575 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.372587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.383784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74115a9-2454-488a-b841-9a2948d7786c service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:10.389529 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:10.390170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:10.390482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:10.390749 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.392807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.422980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.424636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.434941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1287/2568] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:10.458502 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.460160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f4714-7cc9-4d7c-a4b4-1518d9f65430 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.470446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1282/2569] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:18.624220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:18.637460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304f21-0d4e-43d1-a9b2-ecc00a010900 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:18.642396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:18.643624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.644011 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.644526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.647273 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:18.739722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:18.741193 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:18.757638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1288/2570] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:20.465386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=28 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:20.917906 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.918194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.918470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.937774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:20.939019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:21.004026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1283/2571] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:21.061572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:21.064588 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:21.156519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c10f9-2f5a-4b45-88b1-9c5d7cf343e0 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:21.163120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:21.163355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:21.163659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:21.163824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:21.174589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:21.176327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:21.186971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1289/2572] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:47:21.595030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:21.605990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05c19-4bff-4083-8abd-e344d8b8b508 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:21.609783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:21.610446 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:21.610727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:21.611003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:21.612858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:21.626973 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:21.628496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:21.640372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1284/2573] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:23.489986 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.491886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.515966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326fcf-380e-4c35-a7c8-4f128f651451 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.524249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.525673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.526156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.526592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] PATH_INFO: `/v3/users/0431b1f25497443ba483b3c440669080` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.527948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0431b1f25497443ba483b3c440669080)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.530182 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:23.558218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:23.602022 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0431b1f25497443ba483b3c440669080'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.602890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0431b1f25497443ba483b3c440669080'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.611429 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0431b1f25497443ba483b3c440669080'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.624978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0431b1f25497443ba483b3c440669080'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.626104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328255be-dfbe-4493-b9a4-32714631ef0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0431b1f25497443ba483b3c440669080'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.640101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1290/2574] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/users/0431b1f25497443ba483b3c440669080 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:23.921668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.935045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e86d-a87b-4ea9-ac40-0b0820e06622 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.017825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.018909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.019346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.019709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] PATH_INFO: `/v3/projects/9e36ab03283d4ce6a2fed5e111e03d34` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.021208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e36ab03283d4ce6a2fed5e111e03d34)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.023281 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.082325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e36ab03283d4ce6a2fed5e111e03d34', 'request_id': 'req-bc129584-e8a6-4471-8dea-392103be1da1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.090513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e36ab03283d4ce6a2fed5e111e03d34', 'request_id': 'req-bc129584-e8a6-4471-8dea-392103be1da1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.098899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e36ab03283d4ce6a2fed5e111e03d34', 'request_id': 'req-bc129584-e8a6-4471-8dea-392103be1da1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.115514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] The token cache is being invalidate because project 9e36ab03283d4ce6a2fed5e111e03d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:24.116163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.116884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-bc129584-e8a6-4471-8dea-392103be1da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.118692 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1285/2575] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/projects/9e36ab03283d4ce6a2fed5e111e03d34 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:24.123793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.124300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.124581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.144597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:24.146323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.229400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1291/2576] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:24.237734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.238018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.238298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.259119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:24.260397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.270702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1286/2577] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:24.275281 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.285802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabc1cb-1da5-4fa8-b70c-aa00b92c03db None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.290748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.291457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.291832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.292112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.292860 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:24.293166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.294916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.313133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1292/2578] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:24.315504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.327049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86ec1-518d-49d4-b340-6f92bb67a245 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.333405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.334377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.334377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.334642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.335420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.337511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.354468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:24.377072 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1287/2579] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:24.381511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.393448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4839-e713-44e4-b2c6-91db3c92800b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.483005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.483824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.484211 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.484568 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.485975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.488234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.510968 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1293/2580] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:24.515563 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.527135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817c2ee-0b5e-49c0-a5b5-e9f6ee0319df admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.534524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.535357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.535673 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.535934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.536738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.538383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.551416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1288/2581] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:24.556189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.568066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408a2-d07b-4463-a1eb-9df3431911ad admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.573165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.573858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.574138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.574418 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.575288 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.576977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcfbba-2618-40e3-b864-f1bc122fcf07 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.583382 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:24.590053 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1294/2582] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:24.594727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.605765 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d517-f148-4fea-94cf-e00033fe322a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.610571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.611464 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.611781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.612053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] PATH_INFO: `/v3/projects/a9f9a22ad1e74798b9b2f7d85f89a4b6/users/4e987a71a29243dbac6c23e337765508/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.627802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f9a22ad1e74798b9b2f7d85f89a4b6, user_id=4e987a71a29243dbac6c23e337765508, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.630637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.645586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1289/2583] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:47:24 2022] PUT /identity/v3/projects/a9f9a22ad1e74798b9b2f7d85f89a4b6/users/4e987a71a29243dbac6c23e337765508/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:24.651783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.652068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.652337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.670941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:24.672321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.748741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1295/2584] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:24.759003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.760901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.838984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc03-a958-494b-ba1b-dc27bc2d471a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.843944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.844611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.844893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.845253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.857256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.858429 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0affaa-f1e0-4dca-9e6e-12fefec75b24 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.870511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1290/2585] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:25.803392 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.805070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.888788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046fc1-3ab3-4c24-bc18-39cab63defd3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.917577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.921602 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.922202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.922638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.925268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.949791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.951682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.970528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1296/2586] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:30.069789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.070277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.070371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.121103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] MFA Rules not processed for user `4e987a71a29243dbac6c23e337765508`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:30.123259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.231682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.234129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.258317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1291/2587] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:30.264445 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c5bc-f211-4703-ba9b-d1871551a10b service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.272335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.273447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.273930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.274208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] PATH_INFO: `/v3/users/0352a80bdc174b9a9df4eca60b81eba4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.275126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.275934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0352a80bdc174b9a9df4eca60b81eba4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.276712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.278514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.360324 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:30.365975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0352a80bdc174b9a9df4eca60b81eba4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.366784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0352a80bdc174b9a9df4eca60b81eba4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.376396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0352a80bdc174b9a9df4eca60b81eba4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.391571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728735-6b93-46c4-a800-f45f649b9482 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.393479 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0352a80bdc174b9a9df4eca60b81eba4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.394290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0352a80bdc174b9a9df4eca60b81eba4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.400482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.400482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.400482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.400482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.403031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.419397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.421467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.426532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1297/2588] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:47:30 2022] DELETE /identity/v3/users/0352a80bdc174b9a9df4eca60b81eba4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:30.432781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1292/2589] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:30.670156 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.673688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.682916 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:30.779979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b45b6-6671-421f-9b22-73aac7ffac89 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.790327 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.791485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.793069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.793318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] PATH_INFO: `/v3/projects/2fa2c4d6423444e487d259062656129b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.795266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa2c4d6423444e487d259062656129b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.797277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.876996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa2c4d6423444e487d259062656129b', 'request_id': 'req-ca881f31-dd4b-41f5-a51f-01bff1be4f79'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.885702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa2c4d6423444e487d259062656129b', 'request_id': 'req-ca881f31-dd4b-41f5-a51f-01bff1be4f79'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.896551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa2c4d6423444e487d259062656129b', 'request_id': 'req-ca881f31-dd4b-41f5-a51f-01bff1be4f79'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.916146 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] The token cache is being invalidate because project 2fa2c4d6423444e487d259062656129b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:30.917172 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.917639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:30.922397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1298/2590] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:47:30 2022] DELETE /identity/v3/projects/2fa2c4d6423444e487d259062656129b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:30.927880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.949889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab958-72d4-4774-ba04-bd58e5e8e467 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.022309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.023376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.023751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.024101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] PATH_INFO: `/v3/users/fe9fab80fae0469e870d9440f88065d0` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.025781 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9fab80fae0469e870d9440f88065d0)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.027845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.100939 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9fab80fae0469e870d9440f88065d0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.102060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9fab80fae0469e870d9440f88065d0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.102748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9fab80fae0469e870d9440f88065d0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.124284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9fab80fae0469e870d9440f88065d0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.137828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6e0608cc-390a-4283-a923-f33b8b6e7bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9fab80fae0469e870d9440f88065d0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.160459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1293/2591] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:47:30 2022] DELETE /identity/v3/users/fe9fab80fae0469e870d9440f88065d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:31.440033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.442406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:31.463222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881f31-dd4b-41f5-a51f-01bff1be4f79 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.551291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.553110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.553761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.554243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] PATH_INFO: `/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.555905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afaf41d5b6e49c6a6dc781b1ffaadca)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.558042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.608633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.628004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afaf41d5b6e49c6a6dc781b1ffaadca', 'request_id': 'req-b9395e16-a14b-4fe5-bc5c-57efd7cda803'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.636437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afaf41d5b6e49c6a6dc781b1ffaadca', 'request_id': 'req-b9395e16-a14b-4fe5-bc5c-57efd7cda803'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.643632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afaf41d5b6e49c6a6dc781b1ffaadca', 'request_id': 'req-b9395e16-a14b-4fe5-bc5c-57efd7cda803'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.658397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] The token cache is being invalidate because project 7afaf41d5b6e49c6a6dc781b1ffaadca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:31.658786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.659528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:31.661231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1299/2592] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:47:31 2022] DELETE /identity/v3/projects/7afaf41d5b6e49c6a6dc781b1ffaadca => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:32.143572 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.144185 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.144557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.168152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] MFA Rules not processed for user `4e987a71a29243dbac6c23e337765508`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.170016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.228608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.245062 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1294/2593] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:32.616474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.619855 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.705279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395e16-a14b-4fe5-bc5c-57efd7cda803 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.711501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.712733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.713017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.713292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.715262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.726625 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.728150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11194a3-5263-4c5e-ad59-ff5346c7d0bf service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.738398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1300/2594] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:42.733627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=5,keystone:SELECT=37,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.999671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.010445 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1fa8-0890-4ee6-aa36-b42f79196637 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.015208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.015901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.016180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.016463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.018596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.093376 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.094760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.106157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1295/2595] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:04.715300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.715843 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.715944 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.734815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:04.736152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.807256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1301/2596] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:04.821509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.823123 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.910313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506637c1-384b-4b3c-9994-84c8fe9471ed service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.917540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.918189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.918471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.918742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.929117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.930782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.939316 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1296/2597] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:48:05.340709 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.342786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.357644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94463-187d-4b7c-a585-737b504b48c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.363123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.364395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.364974 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.365454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.368460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.392130 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.394486 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1c1b-15e8-4ac9-a8fa-dcfb9602e35e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.415471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1302/2598] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:11.490915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.492564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.511030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2972ab-9a8b-4d73-a75f-6719bf301569 service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.518176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.518909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.519441 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.519595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.521952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.615632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:11.620149 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.622600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a321-9711-4fe6-856b-eabc8e28e0d7 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.648907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1297/2599] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:15.406832 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=31 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:18.899780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.900886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.900886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.902567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1303/2600] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 26 12:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:18.908641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e698682-c6be-4d6d-b46c-b1c1db5691fb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.909302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e698682-c6be-4d6d-b46c-b1c1db5691fb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.909302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e698682-c6be-4d6d-b46c-b1c1db5691fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.930991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3e698682-c6be-4d6d-b46c-b1c1db5691fb None None] MFA Rules not processed for user `29b77d3d3a1345f98194174676e35873`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:18.932908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e698682-c6be-4d6d-b46c-b1c1db5691fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.945283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1298/2601] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 26 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:18.960580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.962335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.027620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b100d-7756-4edf-acea-0e932499a0a4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:19.032294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:19.033196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:19.033621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:19.034123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:19.050196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:19.051792 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:19.064775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1304/2602] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:21.021771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.022681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.022786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.041284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:21.042463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.050744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1299/2603] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:21.076578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.092488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95193-ebd6-432c-8edb-ab6f218b4d8a service glance] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.098045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.098690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.099004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.099274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.108875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.110960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.119450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1305/2604] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:48:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:48:31.035742 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=13 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:31.115999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=32 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:39.297805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.299789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.328197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85e64-88f2-4ebd-bbc2-86df0929690c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.336506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.337602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.337872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.338175 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.340680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.358873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.360661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38be6f4-36b1-44e5-9f08-2848effedf83 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:39.376720 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1300/2605] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:40.212153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.222898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4ec5-009d-4274-8cfd-f75b894214a4 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.226500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.227180 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.227460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.227766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.229646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.240682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.242145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.262035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1306/2606] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:40.570095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.570681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.570681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.591950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] MFA Rules not processed for user `ab469b18ce0444d9884cdddc34ef7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:40.593341 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.661151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1301/2607] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:41.015714 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.025519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f39fe-cfd1-4487-8b17-de8a43d71f9e service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.029481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.030127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.030403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.030679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.032587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.043208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.044682 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b97081-c9d1-4b58-8fc0-c5281811c0b1 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.053272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1307/2608] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:41.794174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.797539 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.878088 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2ebb9-1d0f-412d-83e2-8b94bd24522d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.883098 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.883783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.884064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.884407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.886189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.898640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.900294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.911166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1302/2609] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:42.152026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.152703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.153570 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.174727 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:42.176149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.193141 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1308/2610] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:42.207410 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.219921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ef1c-453e-45d6-bec9-8bcc6a3125fe service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.225009 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.225669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.225952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.226227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.236110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.237852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.247227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1303/2611] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:48:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:48:52.167679 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=15 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.244004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=69 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:54.340482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:54.351384 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d76c-6897-489f-9a24-3daef0e8c98b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:54.355899 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:54.356643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:54.356925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:54.357201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:54.359054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:54.438532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:54.440023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:54.451052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1309/2612] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:02.306546 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:02.308217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:02.325260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c830-9353-4d44-8950-c10a158fa163 service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:02.330458 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:02.331416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:02.331770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:02.332052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] PATH_INFO: `/v3/users/8d9bf2dcfce24386a1aaf9709d88da45` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:02.333260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9bf2dcfce24386a1aaf9709d88da45)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:02.335204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:02.385808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9bf2dcfce24386a1aaf9709d88da45'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.386537 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9bf2dcfce24386a1aaf9709d88da45'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.387699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9bf2dcfce24386a1aaf9709d88da45'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.400322 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9bf2dcfce24386a1aaf9709d88da45'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.410927 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9bf2dcfce24386a1aaf9709d88da45'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.432411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1304/2613] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:49:02 2022] DELETE /identity/v3/users/8d9bf2dcfce24386a1aaf9709d88da45 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:02.618375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:02.630400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5459d-e45c-4993-892a-bf8fa32ccdd4 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:02.695674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:02.696497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:02.696778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:02.697052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] PATH_INFO: `/v3/projects/c1f2f503ef674a4b97f848b69f8b63c5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:02.698508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f2f503ef674a4b97f848b69f8b63c5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:02.701139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:02.750527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f2f503ef674a4b97f848b69f8b63c5', 'request_id': 'req-5ac717f6-15b2-4951-a942-054b23f16e9d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.757118 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f2f503ef674a4b97f848b69f8b63c5', 'request_id': 'req-5ac717f6-15b2-4951-a942-054b23f16e9d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.763973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f2f503ef674a4b97f848b69f8b63c5', 'request_id': 'req-5ac717f6-15b2-4951-a942-054b23f16e9d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.779164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] The token cache is being invalidate because project c1f2f503ef674a4b97f848b69f8b63c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:02.779484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.780219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.781756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1310/2614] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:49:02 2022] DELETE /identity/v3/projects/c1f2f503ef674a4b97f848b69f8b63c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:02.786105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:02.787580 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:02.801190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332918-0760-4468-922c-880d20a9f0f7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:02.861041 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:02.861966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:02.862241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:02.862518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] PATH_INFO: `/v3/users/7492848bf86644b0805a2e67f80bce9e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:02.863921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7492848bf86644b0805a2e67f80bce9e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:02.865901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:02.917411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7492848bf86644b0805a2e67f80bce9e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.918101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7492848bf86644b0805a2e67f80bce9e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.918712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7492848bf86644b0805a2e67f80bce9e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.931672 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7492848bf86644b0805a2e67f80bce9e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.938514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7492848bf86644b0805a2e67f80bce9e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:02.940356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.954737 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1305/2615] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:49:02 2022] DELETE /identity/v3/users/7492848bf86644b0805a2e67f80bce9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:03.141722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:03.143490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:03.159467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac717f6-15b2-4951-a942-054b23f16e9d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:03.183638 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.228108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:03.228108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:03.228108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:03.228667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] PATH_INFO: `/v3/projects/0ac11ef573454889b1fb222d2cfa7a35` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:03.229778 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac11ef573454889b1fb222d2cfa7a35)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:03.232084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:03.283920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac11ef573454889b1fb222d2cfa7a35', 'request_id': 'req-0237a423-8f49-46cf-b401-74e339fcd245'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:03.290626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac11ef573454889b1fb222d2cfa7a35', 'request_id': 'req-0237a423-8f49-46cf-b401-74e339fcd245'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:03.296977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac11ef573454889b1fb222d2cfa7a35', 'request_id': 'req-0237a423-8f49-46cf-b401-74e339fcd245'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:03.310532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] The token cache is being invalidate because project 0ac11ef573454889b1fb222d2cfa7a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:03.310815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:03.311466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:03.313116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1311/2616] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:49:03 2022] DELETE /identity/v3/projects/0ac11ef573454889b1fb222d2cfa7a35 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:12.953013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:13.307347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:45.840146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:45.841944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:45.905161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3ca5-a300-41a1-82e1-db377818d7ad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:45.962802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:45.963459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:45.963763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:45.964033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:45.965926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:46.039270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:46.040700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:46.052482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1306/2617] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:49.347245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:49.348776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.362775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a423-8f49-46cf-b401-74e339fcd245 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:49.367987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:49.368890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.369169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.369440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] PATH_INFO: `/v3/users/e811736979c44b02b14fecb74c6bd7ab` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.370659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e811736979c44b02b14fecb74c6bd7ab)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:49.372642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:49.433124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e811736979c44b02b14fecb74c6bd7ab'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.434020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e811736979c44b02b14fecb74c6bd7ab'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.444355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e811736979c44b02b14fecb74c6bd7ab'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.459914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e811736979c44b02b14fecb74c6bd7ab'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.460817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0af5cf1f-686c-4c8e-98f3-338ea250cf67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e811736979c44b02b14fecb74c6bd7ab'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.476208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1312/2618] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:49:49 2022] DELETE /identity/v3/users/e811736979c44b02b14fecb74c6bd7ab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:49.680146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:49.697603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fe4e-4130-4ce3-996f-67202b494380 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:49.766894 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:49.767848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.768204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.768443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] PATH_INFO: `/v3/projects/2675272fb40d4847819f83ec04afecef` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.770074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2675272fb40d4847819f83ec04afecef)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:49.772285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:49.781233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:49.826981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2675272fb40d4847819f83ec04afecef', 'request_id': 'req-b9c90d86-71fe-4d2b-901d-1bd5ce104279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.834420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2675272fb40d4847819f83ec04afecef', 'request_id': 'req-b9c90d86-71fe-4d2b-901d-1bd5ce104279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.841172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2675272fb40d4847819f83ec04afecef', 'request_id': 'req-b9c90d86-71fe-4d2b-901d-1bd5ce104279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.857329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] The token cache is being invalidate because project 2675272fb40d4847819f83ec04afecef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:49.857611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.858221 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b9c90d86-71fe-4d2b-901d-1bd5ce104279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.859839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1307/2619] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:49:49 2022] DELETE /identity/v3/projects/2675272fb40d4847819f83ec04afecef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:49.865962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.866250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.866535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.887333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:49.888598 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.956523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1313/2620] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:49.965557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.965976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.966412 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.986592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:49.987911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.996789 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1308/2621] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:50.001398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.011746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717378-b248-4d86-b13d-0c7c952086b3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.017354 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.018274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.018548 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.018817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.019975 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:50.020280 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.021912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.035209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1314/2622] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:50.039798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.049644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e85b-eb7c-44d8-b1d3-4758527f5e67 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.056174 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.056842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.057126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.057395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.058121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.060048 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.089275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1309/2623] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:50.093687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.104494 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914add-e888-4b76-8601-e544acb180e7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.171514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.172217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.172492 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.172761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.173470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.175592 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.182549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:50.200784 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1315/2624] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:50.205019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.216521 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674b2e-350d-42fa-8b26-c781914ce154 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.222351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.223028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.223307 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.223584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.224349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.226011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.238699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1310/2625] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:50.243364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.257829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c5db-b0c1-44c8-a1f3-30d4e62a185e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.264075 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.264764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.265046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.265324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.266039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.267750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3ee6a-da34-4e47-8329-643eda4bed18 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.279550 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1316/2626] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:50.285340 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.296585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d0f1-f0a8-4f76-aa64-4bda98093c38 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.302511 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.303417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.303729 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.304004 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] PATH_INFO: `/v3/projects/93d5b6bba38643bfb76f083e230b3d22/users/eddc5d9ac2a74507bca19e06f0051ae1/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.320863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d5b6bba38643bfb76f083e230b3d22, user_id=eddc5d9ac2a74507bca19e06f0051ae1, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.323711 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.339012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1311/2627] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:49:50 2022] PUT /identity/v3/projects/93d5b6bba38643bfb76f083e230b3d22/users/eddc5d9ac2a74507bca19e06f0051ae1/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:50.344561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd07f-184b-4dd5-af56-ae6b8adea880 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.344871 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd07f-184b-4dd5-af56-ae6b8adea880 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.345203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd07f-184b-4dd5-af56-ae6b8adea880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.366936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-63ecd07f-184b-4dd5-af56-ae6b8adea880 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:50.368205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-63ecd07f-184b-4dd5-af56-ae6b8adea880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.435365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1317/2628] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:50.445888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.448104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.511476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4118-621c-4bea-bdf0-32a1ec93a090 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.516092 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.516814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.517132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.517442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.529070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.530530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.541390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1312/2629] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:54.792304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6c31-0254-4fc6-9e2c-f079239d52b2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.793244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6c31-0254-4fc6-9e2c-f079239d52b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.793563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6c31-0254-4fc6-9e2c-f079239d52b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.824116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-aa8c6c31-0254-4fc6-9e2c-f079239d52b2 None None] MFA Rules not processed for user `eddc5d9ac2a74507bca19e06f0051ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.825668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aa8c6c31-0254-4fc6-9e2c-f079239d52b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.898674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1318/2630] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:54.914840 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.916567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.973829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:55.021730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefc7e9-4655-44fa-b905-96be30ae3247 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.027310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.027926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.028204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.028474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.038218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.047684 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.061198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1313/2631] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:56.732287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.732905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.732905 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.756215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] MFA Rules not processed for user `eddc5d9ac2a74507bca19e06f0051ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:56.757630 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:56.764793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1319/2632] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:05.056017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=18 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:05.932101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:05.933593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:05.951570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb692c-ec59-4bca-8830-93ea61f26352 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:05.958865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:05.959553 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:05.959873 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:05.960146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:05.962166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:05.976024 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:05.977834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6e4f-0c54-439c-92e6-341041aeba83 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:05.989888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1314/2633] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:06.749091 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:15.984418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:03.826824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:03.828522 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:03.941642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d4688-d9c3-45c7-a977-b0b7f12a9176 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:03.946008 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:03.946668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:03.946953 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:03.947221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:03.949357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:04.032078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:04.033552 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:04.043443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1320/2634] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:51:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:14.038797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=71 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:15.196370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:15.197010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:15.197010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:15.218740 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] MFA Rules not processed for user `ab469b18ce0444d9884cdddc34ef7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:15.220012 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:15.228862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1315/2635] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:51:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:25.212831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:35.240562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:35.243054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:35.287405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2da7-fcf2-46e5-a9d1-8949e387bdb2 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:35.291782 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:35.292431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:35.292717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:35.292993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:35.295272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:35.374658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:35.376071 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7510-0c09-4e3d-82fd-723748297b75 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:35.386148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1321/2636] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:37.305688 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:37.319448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a264b11-492f-46ea-9bd3-8d8b26f12baf None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:37.325523 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:37.326182 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:37.326456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:37.326715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:37.328623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:37.341778 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:37.343416 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:37.354480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1316/2637] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:45.381610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=42 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:47.349550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:48.494700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20410750-9b41-4896-b641-265d468d1519 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:48.495188 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20410750-9b41-4896-b641-265d468d1519 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:48.495313 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20410750-9b41-4896-b641-265d468d1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:48.513488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-20410750-9b41-4896-b641-265d468d1519 None None] MFA Rules not processed for user `eddc5d9ac2a74507bca19e06f0051ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:48.514742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-20410750-9b41-4896-b641-265d468d1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:48.523110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1322/2638] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:58.508054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:05.303902 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:05.305420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:05.407635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56304-994d-45af-9cdb-ae62bfa6d43e service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:05.413132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:05.413759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:05.414002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:05.414305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:05.416117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:05.428192 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:05.430068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:05.441270 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1317/2639] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:08.183258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:08.183870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:08.183870 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:08.201970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] MFA Rules not processed for user `4e987a71a29243dbac6c23e337765508`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:08.203151 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:08.265710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1323/2640] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:15.436957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=41 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:18.258274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=25 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:28.805204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:28.815189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4e56-5fb8-437c-bd60-032d545a19f5 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:28.819727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:28.820366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:28.820641 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:28.820898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:28.822874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:28.858044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:28.859310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:28.881585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1318/2641] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:30.327335 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:30.337868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114929-3648-4e27-9c4d-dbae4602bd6a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:30.342101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:30.342746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:30.343024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:30.343300 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:30.345452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:30.359577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:30.361007 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:30.372386 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1324/2642] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:38.567807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:38.579600 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be7e3-d09f-4722-a068-c8db3019429c service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:38.585793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:38.586665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:38.587133 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:38.587745 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:38.589706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:38.602283 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:38.604030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:38.615181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1319/2643] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:39.298079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:39.309851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9641-4dc2-4484-bfcf-2c60446fb847 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:39.317058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:39.317514 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:39.317927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:39.318061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:39.319919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:39.332801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:39.334424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdd1b2-9c67-4899-a9bd-94e630364abe service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:39.351724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1325/2644] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:40.187001 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:40.201064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6aff-f9fe-445d-bc5a-34d8aecaf469 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:40.205663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:40.206459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:40.206827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:40.207202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:40.209916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:40.222996 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:40.224666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:40.233839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1320/2645] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:43.300942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.301523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.301523 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.321801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] MFA Rules not processed for user `eddc5d9ac2a74507bca19e06f0051ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:43.323253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:43.330936 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1326/2646] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:43.663584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:43.672947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b480411-76ed-437a-b036-8cc650c92382 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:43.677594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:43.678248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.678525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.678795 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.680770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:43.692052 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:43.693449 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.702785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1321/2647] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:44.028891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:44.041829 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ef593-bca7-45a8-b41b-bfab7a70306e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:44.048315 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:44.048984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:44.049252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:44.049518 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:44.051563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:44.064407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:44.066084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:44.076875 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1327/2648] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:53.699531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=36 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:54.072254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=21 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:55.722333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.732204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d2a1-2706-4e8a-875b-abf083ee937e service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.736397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.737033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.737335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.737584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.739346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:55.774470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.775858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.797612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1322/2649] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:59.128985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:59.131730 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:59.146608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2219ec-25e4-4137-9c58-a84519dd8ff4 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:59.152525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:59.153365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:59.153802 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:59.154262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:59.156926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:59.171317 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:59.173248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:59.193350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1328/2650] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:02.907399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:02.909721 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:02.923321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce8c72-2337-4ce8-96d2-d4bf4739a030 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:02.928106 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:02.928989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:02.929265 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:02.929551 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] PATH_INFO: `/v3/users/ab469b18ce0444d9884cdddc34ef7247` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:02.930830 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab469b18ce0444d9884cdddc34ef7247)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:02.933547 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:02.985258 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab469b18ce0444d9884cdddc34ef7247'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:02.985968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab469b18ce0444d9884cdddc34ef7247'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:02.986642 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab469b18ce0444d9884cdddc34ef7247'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.000917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab469b18ce0444d9884cdddc34ef7247'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.008654 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab469b18ce0444d9884cdddc34ef7247'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.026627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1323/2651] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:02 2022] DELETE /identity/v3/users/ab469b18ce0444d9884cdddc34ef7247 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:03.203810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:03.216959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab671-564b-42aa-9b0a-59527fd565fc service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:03.281964 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:03.282765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:03.283046 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:03.283325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] PATH_INFO: `/v3/projects/d6fb41c547884511893b768b833f4e90` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:03.284597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fb41c547884511893b768b833f4e90)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:03.287990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:03.337135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fb41c547884511893b768b833f4e90', 'request_id': 'req-c85c9164-b68d-40f0-9001-2469e3c27d8b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.345450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fb41c547884511893b768b833f4e90', 'request_id': 'req-c85c9164-b68d-40f0-9001-2469e3c27d8b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.354301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fb41c547884511893b768b833f4e90', 'request_id': 'req-c85c9164-b68d-40f0-9001-2469e3c27d8b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.369738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] The token cache is being invalidate because project d6fb41c547884511893b768b833f4e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:03.370029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.370686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.372294 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1329/2652] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:03 2022] DELETE /identity/v3/projects/d6fb41c547884511893b768b833f4e90 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:03.376471 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:03.377953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:03.396042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29372b-5411-4f32-ab3c-f67024ee3017 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:03.461881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:03.462775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:03.463050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:03.463314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] PATH_INFO: `/v3/users/24c47fc09165477fac60d14b0e5ba66c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:03.464570 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c47fc09165477fac60d14b0e5ba66c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:03.466531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:03.506430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:03.524206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c47fc09165477fac60d14b0e5ba66c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.524941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c47fc09165477fac60d14b0e5ba66c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.525662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c47fc09165477fac60d14b0e5ba66c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.538180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c47fc09165477fac60d14b0e5ba66c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.544921 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c47fc09165477fac60d14b0e5ba66c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.560233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1324/2653] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:03 2022] DELETE /identity/v3/users/24c47fc09165477fac60d14b0e5ba66c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:03.750051 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:03.751651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:03.765923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9164-b68d-40f0-9001-2469e3c27d8b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:03.841248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:03.842115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:03.842397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:03.842665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] PATH_INFO: `/v3/projects/0e46482975b945498c56fdcdaaa07671` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:03.843866 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e46482975b945498c56fdcdaaa07671)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:03.845764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:03.870789 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:03.899865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e46482975b945498c56fdcdaaa07671', 'request_id': 'req-af7b7615-0445-437f-bf1a-1bf9df13953e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.906176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e46482975b945498c56fdcdaaa07671', 'request_id': 'req-af7b7615-0445-437f-bf1a-1bf9df13953e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.918100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e46482975b945498c56fdcdaaa07671', 'request_id': 'req-af7b7615-0445-437f-bf1a-1bf9df13953e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.933765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] The token cache is being invalidate because project 0e46482975b945498c56fdcdaaa07671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:03.934216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.934845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:03.936448 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1330/2654] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:03 2022] DELETE /identity/v3/projects/0e46482975b945498c56fdcdaaa07671 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:13.299926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.301474 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:13.365687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427d7e-54b3-467d-886f-baabc4b01b32 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.431156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.431946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.432256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.432557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.434557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:13.504956 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.506326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.516396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1325/2655] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:13.929042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:16.692430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:16.694042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:16.708563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7615-0445-437f-bf1a-1bf9df13953e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:16.713535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:16.714712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:16.714991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:16.715263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] PATH_INFO: `/v3/users/4e987a71a29243dbac6c23e337765508` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:16.716601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e987a71a29243dbac6c23e337765508)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:16.718661 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:16.777808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e987a71a29243dbac6c23e337765508'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:16.778462 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e987a71a29243dbac6c23e337765508'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:16.785520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e987a71a29243dbac6c23e337765508'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:16.797942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e987a71a29243dbac6c23e337765508'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:16.798631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5121e5dc-d8a5-40fc-ba45-80cfce783d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e987a71a29243dbac6c23e337765508'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:16.812940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1331/2656] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:16 2022] DELETE /identity/v3/users/4e987a71a29243dbac6c23e337765508 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:17.005114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.015456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36abb-8e5e-47a9-9ab5-5e6acf1d6396 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.031741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.080364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.081230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.081510 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.081766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] PATH_INFO: `/v3/projects/a9f9a22ad1e74798b9b2f7d85f89a4b6` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.082976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f9a22ad1e74798b9b2f7d85f89a4b6)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.084946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.133373 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'request_id': 'req-01b72678-d207-46fc-8ed3-a07395e36cf4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:17.139560 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'request_id': 'req-01b72678-d207-46fc-8ed3-a07395e36cf4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:17.146305 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'request_id': 'req-01b72678-d207-46fc-8ed3-a07395e36cf4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:17.160776 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] The token cache is being invalidate because project a9f9a22ad1e74798b9b2f7d85f89a4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:17.160985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:17.161647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-01b72678-d207-46fc-8ed3-a07395e36cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:17.163260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1326/2657] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:17 2022] DELETE /identity/v3/projects/a9f9a22ad1e74798b9b2f7d85f89a4b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:17.169645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.169962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.170235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.227129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:17.228424 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:17.291477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1332/2658] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:17.299480 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.299916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.300284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.321659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:17.322881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:17.331904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1327/2659] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:17.336368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.346819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4729-0b74-46df-8d6f-db4690ad0720 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.351498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.352260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.352571 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.352799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.353527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:17.353811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.355410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.370853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1333/2660] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:54:17.372003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.381226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f887-ed87-46fe-aa12-89ebe8ce6a62 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.387144 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.387827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.388166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.388367 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.389074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.390981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.425320 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1328/2661] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:17 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:17.430811 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.445129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b17f-5bd6-46f7-8036-c93f7f4d6d18 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.482350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.523166 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.523864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.524140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.524442 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.525153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.527078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.550434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1334/2662] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:17 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:17.553587 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.566888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b67cc-4556-43bf-9e98-4b6246769ea5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.572135 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.572800 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.573080 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.573354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.574087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.575772 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.586876 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1329/2663] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:17.591788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.605567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c356-86ee-4399-9166-5a26ad26f9da admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.610849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.611504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.611838 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.612111 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.612842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.614439 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417183-0e6d-4751-a053-d07147e03aea admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.624957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1335/2664] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:17.629201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.640414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2ca1-e5c8-4093-9ca2-00452f7b20fa admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.646808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.647722 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.648031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.648304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] PATH_INFO: `/v3/projects/c7ca0ebc6b5c474d971d30031890f18c/users/08cbe9d6b7ff42069a794e8c0ab445a2/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.666853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ca0ebc6b5c474d971d30031890f18c, user_id=08cbe9d6b7ff42069a794e8c0ab445a2, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.669662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.684248 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1330/2665] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:17 2022] PUT /identity/v3/projects/c7ca0ebc6b5c474d971d30031890f18c/users/08cbe9d6b7ff42069a794e8c0ab445a2/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:17.694375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.694892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.694992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.722558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] MFA Rules not processed for user `08cbe9d6b7ff42069a794e8c0ab445a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:17.723873 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:17.798431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1336/2666] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:17.809989 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:17.811771 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:17.865629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.894470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9cbed-051a-47c8-b9ad-c8d1aa3a7bc6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:17.900751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:17.901581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:17.901856 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:17.902129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:17.910734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:17.912369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42f649-109d-4910-8d6c-429b29af2d9b service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:17.922054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1331/2667] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:18.139365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:18.218109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b11b3-1365-4ec4-b765-7443a3db9cde None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:18.223894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:18.224774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:18.225055 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:18.225325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] PATH_INFO: `/v3/users/08cbe9d6b7ff42069a794e8c0ab445a2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:18.226619 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cbe9d6b7ff42069a794e8c0ab445a2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:18.228665 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:18.277378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:18.284725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cbe9d6b7ff42069a794e8c0ab445a2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.285589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cbe9d6b7ff42069a794e8c0ab445a2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.293065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cbe9d6b7ff42069a794e8c0ab445a2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.306997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cbe9d6b7ff42069a794e8c0ab445a2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.307798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cbe9d6b7ff42069a794e8c0ab445a2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.323454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1337/2668] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:18 2022] DELETE /identity/v3/users/08cbe9d6b7ff42069a794e8c0ab445a2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:18.328226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:18.328739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:18.328854 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:18.347049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:18.348277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:18.410940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1332/2669] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:18.422077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:18.423511 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:18.484545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1477-c5c4-4558-8262-c381f5479810 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:18.488290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:18.488951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:18.489234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:18.489512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:18.500077 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:18.501515 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e78b-9da6-48c5-a64d-3d2d9eb0e565 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:18.514733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1338/2670] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:18.804387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:18.805967 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:18.819644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb41d6b-b4fe-4e2c-82dc-e9dfd953b62b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:18.824766 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:18.825647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:18.825936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:18.826206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] PATH_INFO: `/v3/projects/c7ca0ebc6b5c474d971d30031890f18c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:18.827406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ca0ebc6b5c474d971d30031890f18c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:18.830170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:18.882287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ca0ebc6b5c474d971d30031890f18c', 'request_id': 'req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.888628 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ca0ebc6b5c474d971d30031890f18c', 'request_id': 'req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.898835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ca0ebc6b5c474d971d30031890f18c', 'request_id': 'req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.918614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] The token cache is being invalidate because project c7ca0ebc6b5c474d971d30031890f18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:18.918905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.919629 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-15a6ca6f-b8ae-48f1-a685-9a976f2a8dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:18.921284 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1333/2671] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:18 2022] DELETE /identity/v3/projects/c7ca0ebc6b5c474d971d30031890f18c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:18.926277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:18.926755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:18.926869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:18.945017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:18.946246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:19.008673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1339/2672] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:19.017227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.017513 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.018178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.038205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:19.039554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:19.048386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1334/2673] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:19.053501 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.068599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fe169-b1d9-491f-811a-1fc1918de7f4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.076207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.076865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.077142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.077408 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.078139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:19.078437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.080041 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.093488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1340/2674] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:19.098545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.110976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64eb71-a50b-4dde-9d97-e2ca65ca2052 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.117014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.117661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.117940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.118206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.118889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.121050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.148905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1335/2675] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:19 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:19.153430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.163507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c4e-0462-4095-9e1c-2b8af59b3dd4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.207741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:19.224113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.224791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.225076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.225350 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.226052 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.228049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.251278 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1341/2676] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:19 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:19.255585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.266249 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff11b2-bed7-4d49-bcfe-b1b532f89293 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.271443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.272138 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.272404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.272681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.273417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.275076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.285984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1336/2677] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:19.290266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.300742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b628e-f1b0-483d-9cb4-40ede34ec09a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.306769 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.307438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.307858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.308148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.308890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.310505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff6876-4c79-49dc-97e3-ed0a031fc7b9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.321079 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1342/2678] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:19.325366 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.335450 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d4a-9285-4c47-8110-0849e26bf2f0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.341804 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.342687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.342962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.343229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] PATH_INFO: `/v3/projects/a9e59208cc194154bafb0f605e4470b0/users/74fae12e8bb24fe6ac8e8d32b38cb1fb/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.351919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:19.360499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e59208cc194154bafb0f605e4470b0, user_id=74fae12e8bb24fe6ac8e8d32b38cb1fb, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.363217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.377759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1337/2679] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:19 2022] PUT /identity/v3/projects/a9e59208cc194154bafb0f605e4470b0/users/74fae12e8bb24fe6ac8e8d32b38cb1fb/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:19.383035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b7a3-a39c-4e19-b1f1-23402bdb998a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.383347 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b7a3-a39c-4e19-b1f1-23402bdb998a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.383668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b7a3-a39c-4e19-b1f1-23402bdb998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.403056 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98c5b7a3-a39c-4e19-b1f1-23402bdb998a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:19.404312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98c5b7a3-a39c-4e19-b1f1-23402bdb998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:19.476436 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1343/2680] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:19.486349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:19.488186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:19.547086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427267-18f4-486c-9901-af9069dfd73f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:19.551056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:19.551738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:19.552019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:19.552294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:19.564293 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:19.566792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:19.579457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1338/2681] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:20.238583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.239222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.239222 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.270496 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] MFA Rules not processed for user `74fae12e8bb24fe6ac8e8d32b38cb1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:20.271963 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:20.344203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1344/2682] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:20.349090 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.359948 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459372b-f8b6-4819-b5e9-0d9e388511b5 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.365527 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.366214 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.366489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.366758 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.367457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.369456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.401128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1339/2683] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:20 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:20.406027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.417326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a30f5-2274-41ce-9e20-ebc0572cad9e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.471952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:20.481463 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.482153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.482434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.482711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.483446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.485397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.508201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1345/2684] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:20 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:20.512022 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.522759 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7565-fa58-4264-958f-54df989c101b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.527509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.528222 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.528503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.528775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.529505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.531172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.546761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1340/2685] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:20.548104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.560021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cc253-86ce-4dc2-ae35-4a2a40cea6d4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.565454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.566793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.567239 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.567567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] PATH_INFO: `/v3/projects/3abe2f9a01db49608e50662f7553fddd/users/2e9eae7ca6c941e2949f97d3703d2db3/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.585261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abe2f9a01db49608e50662f7553fddd, user_id=2e9eae7ca6c941e2949f97d3703d2db3, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.587971 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.603864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1346/2686] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:20 2022] PUT /identity/v3/projects/3abe2f9a01db49608e50662f7553fddd/users/2e9eae7ca6c941e2949f97d3703d2db3/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:20.607935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.618282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500d89c-c1e5-43f1-9960-5d9819e4aef0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.677476 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.678156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.678436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.678709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.679454 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.681207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1dd2-6617-43f2-b534-d4f3b632d447 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.691348 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1341/2687] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:20.696136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:20.707129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5f02-4d01-46be-ad73-13fe7d59b187 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:20.712253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:20.713135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:20.713415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:20.713666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] PATH_INFO: `/v3/projects/3abe2f9a01db49608e50662f7553fddd/users/2e9eae7ca6c941e2949f97d3703d2db3/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:20.715816 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abe2f9a01db49608e50662f7553fddd, user_id=2e9eae7ca6c941e2949f97d3703d2db3, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:20.718465 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:20.729891 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1347/2688] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:20 2022] PUT /identity/v3/projects/3abe2f9a01db49608e50662f7553fddd/users/2e9eae7ca6c941e2949f97d3703d2db3/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:21.406002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:21.406578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:21.406578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:21.434762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] MFA Rules not processed for user `2e9eae7ca6c941e2949f97d3703d2db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:21.436047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:21.483677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:21.514500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1342/2689] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:22.000400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:22.002107 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:22.085508 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a949-9a4b-48dc-bb74-82bd4fbd3220 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:22.090976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:22.092042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:22.092042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:22.092245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:22.093970 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:22.106208 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:22.107849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:22.118260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1348/2690] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:22.603383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:22.667954 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d2833-f1e7-4c75-848a-153392a6f6a3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:22.672763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:22.673659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:22.673941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:22.674216 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] PATH_INFO: `/v3/users/74fae12e8bb24fe6ac8e8d32b38cb1fb` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:22.675423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fae12e8bb24fe6ac8e8d32b38cb1fb)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:22.677451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:22.733850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fae12e8bb24fe6ac8e8d32b38cb1fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:22.734583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fae12e8bb24fe6ac8e8d32b38cb1fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:22.735291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fae12e8bb24fe6ac8e8d32b38cb1fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:22.748070 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fae12e8bb24fe6ac8e8d32b38cb1fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:22.754889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fae12e8bb24fe6ac8e8d32b38cb1fb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:22.769922 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1343/2691] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:22 2022] DELETE /identity/v3/users/74fae12e8bb24fe6ac8e8d32b38cb1fb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:22.956282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:22.969389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87205-8576-4220-b6d6-52bc3e3c502a service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.030525 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.031417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.031729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.032002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] PATH_INFO: `/v3/projects/a9e59208cc194154bafb0f605e4470b0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.033205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e59208cc194154bafb0f605e4470b0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.035139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.076996 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:23.085114 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e59208cc194154bafb0f605e4470b0', 'request_id': 'req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.091810 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e59208cc194154bafb0f605e4470b0', 'request_id': 'req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.097256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e59208cc194154bafb0f605e4470b0', 'request_id': 'req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.112049 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] The token cache is being invalidate because project a9e59208cc194154bafb0f605e4470b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:23.112336 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.113045 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.114740 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1349/2692] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:22 2022] DELETE /identity/v3/projects/a9e59208cc194154bafb0f605e4470b0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:23.119194 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:23.121254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:23.134890 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ca322-b6f7-4b28-aeda-8494f2588e6c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.189033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:23.195879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.196770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.197056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.197335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] PATH_INFO: `/v3/users/2e9eae7ca6c941e2949f97d3703d2db3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.198520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9eae7ca6c941e2949f97d3703d2db3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.201235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.255985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9eae7ca6c941e2949f97d3703d2db3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.256577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9eae7ca6c941e2949f97d3703d2db3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.257208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9eae7ca6c941e2949f97d3703d2db3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.269898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9eae7ca6c941e2949f97d3703d2db3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.276957 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5c441d06-1eca-4a4f-b108-2d909491b7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9eae7ca6c941e2949f97d3703d2db3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.291507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1344/2693] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:23 2022] DELETE /identity/v3/users/2e9eae7ca6c941e2949f97d3703d2db3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:23.477093 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:23.478546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:23.492828 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b2f2-6a2d-4fe0-84cd-14ee387e976a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.550973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.551793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.552078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.552353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] PATH_INFO: `/v3/projects/3abe2f9a01db49608e50662f7553fddd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.553565 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abe2f9a01db49608e50662f7553fddd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.555504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.606162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abe2f9a01db49608e50662f7553fddd', 'request_id': 'req-436097e8-74d7-4df9-8e99-68585b8a1987'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.612995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abe2f9a01db49608e50662f7553fddd', 'request_id': 'req-436097e8-74d7-4df9-8e99-68585b8a1987'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.620191 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abe2f9a01db49608e50662f7553fddd', 'request_id': 'req-436097e8-74d7-4df9-8e99-68585b8a1987'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.636413 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] The token cache is being invalidate because project 3abe2f9a01db49608e50662f7553fddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:23.636701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.637351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-436097e8-74d7-4df9-8e99-68585b8a1987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:23.638943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1350/2694] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:23 2022] DELETE /identity/v3/projects/3abe2f9a01db49608e50662f7553fddd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:23.644483 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.644976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.645073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.665726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:23.666931 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:23.739639 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1345/2695] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:23.742215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.742500 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.742755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.766255 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:23.767489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:23.777934 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1351/2696] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:23.782802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:23.796503 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7327c-ce4e-4162-a920-3178467a2b07 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.804044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.804827 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.805196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.805550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.806651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:23.807066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.809219 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.821558 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1346/2697] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:23.826228 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:23.836796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ef1e5-d9e7-4605-8d85-9cd1c3451870 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.842123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.842776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.843059 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.843330 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.844064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.845973 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.878984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1352/2698] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:23 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:23.882209 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:23.893347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cd74-1d63-4093-86b4-768a98ca4612 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:23.963431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:23.964519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:23.964844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:23.965116 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:23.965816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:23.967798 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:23.976975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:23.991027 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1347/2699] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:23 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:23.995793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.007387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178968-5891-438f-9aff-2fea47fe2136 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.014219 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.014893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.015165 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.015434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.016202 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.018154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.029716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1353/2700] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:24.034156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.045129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab71ef-b0a0-47a6-8b14-25b16b9b6143 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.050896 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.051754 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.052030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.052304 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.053028 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.054686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2e58-c94d-4135-bab5-798cd4609904 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.065645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1348/2701] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:24.069773 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.080109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4873-9aae-4405-9974-e65d9095bdbd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.084743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.085655 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.085935 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.086207 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] PATH_INFO: `/v3/projects/eeca1f77bb5c40858bab0b3c21a8da27/users/a08adf6754914494b9f1bf9f59d1ad43/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.100864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeca1f77bb5c40858bab0b3c21a8da27, user_id=a08adf6754914494b9f1bf9f59d1ad43, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.103517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.105845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:24.119906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1354/2702] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:24 2022] PUT /identity/v3/projects/eeca1f77bb5c40858bab0b3c21a8da27/users/a08adf6754914494b9f1bf9f59d1ad43/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:24.131496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.131810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.132081 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.161467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] MFA Rules not processed for user `a08adf6754914494b9f1bf9f59d1ad43`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:24.162664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:24.241057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1349/2703] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:24.246115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.325657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363a756-82a5-4c98-9754-3c8292cd877c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.330846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.331510 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.331821 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.332094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.332793 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.334712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.366783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1355/2704] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:24 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:24.372506 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.384204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2748c-5971-499a-b116-024d4486bd09 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.446008 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.446680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.446985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.447279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.448007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.449976 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.471585 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1350/2705] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:24 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:24.475467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.486119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02942b1-b688-4ea8-b33e-7f3242fed9c5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.491561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.492253 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.492534 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.492808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.493540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.495266 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.506799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1356/2706] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:24.511467 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.523055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a0fd-6efe-40da-a192-d778a86ca77f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.528626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.529507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.529819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.530087 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] PATH_INFO: `/v3/projects/6ade336fb23f4c2c9efca7902ece85e2/users/7b9341b44f8e4adc8e4984232e66d4b9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.546031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ade336fb23f4c2c9efca7902ece85e2, user_id=7b9341b44f8e4adc8e4984232e66d4b9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.548734 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.565074 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1351/2707] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:24 2022] PUT /identity/v3/projects/6ade336fb23f4c2c9efca7902ece85e2/users/7b9341b44f8e4adc8e4984232e66d4b9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:24.569348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.581706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75b42-4feb-4cbf-83f9-2bb15d4b6ea4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.651343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.652367 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.652813 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.653092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.653834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.655450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66f2f-ad69-4345-ada7-c2c241d87814 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.670293 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1357/2708] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:24.671808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.685710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb90-033d-4f15-a34d-d0607d0525ee admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.690877 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.691782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.692051 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.692314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] PATH_INFO: `/v3/projects/6ade336fb23f4c2c9efca7902ece85e2/users/7b9341b44f8e4adc8e4984232e66d4b9/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.694397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ade336fb23f4c2c9efca7902ece85e2, user_id=7b9341b44f8e4adc8e4984232e66d4b9, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.697066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.707947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1352/2709] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:24 2022] PUT /identity/v3/projects/6ade336fb23f4c2c9efca7902ece85e2/users/7b9341b44f8e4adc8e4984232e66d4b9/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:24.718809 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.719102 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.719375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.749872 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] MFA Rules not processed for user `7b9341b44f8e4adc8e4984232e66d4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:24.751088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:24.809195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:24.829814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1358/2710] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:24.844659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:24.846706 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:24.879724 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:24.923434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deccc5-3239-468f-a7cd-e8c4379c5c57 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:24.927943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:24.928583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:24.928857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:24.929124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:24.941520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:24.943063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a81dd3-bc44-4411-bcaa-8871fa4e105c service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:24.955632 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1353/2711] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:24.988520 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:25.056361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f3d68-e5a4-44dc-93ab-34a64587e300 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:25.061977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:25.062889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.063175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.063444 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] PATH_INFO: `/v3/users/a08adf6754914494b9f1bf9f59d1ad43` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.064762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08adf6754914494b9f1bf9f59d1ad43)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:25.066756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:25.121179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08adf6754914494b9f1bf9f59d1ad43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.121812 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08adf6754914494b9f1bf9f59d1ad43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.128997 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08adf6754914494b9f1bf9f59d1ad43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.142513 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08adf6754914494b9f1bf9f59d1ad43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.143504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08adf6754914494b9f1bf9f59d1ad43'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.157526 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1359/2712] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:24 2022] DELETE /identity/v3/users/a08adf6754914494b9f1bf9f59d1ad43 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:25.162459 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.162783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.163056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.181173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:25.182386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:25.244134 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1354/2713] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:25.258686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:25.260674 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:25.331521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7e859-9428-4bcc-8244-ad924ecd54c3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:25.337689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:25.338344 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.338627 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.338897 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.351699 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:25.353133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:25.363941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1360/2714] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:25.653047 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:25.654499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:25.667354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7b66-0e4d-4a2d-8ddd-fc620f12e6d7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:25.673392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:25.674282 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.674557 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.674845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] PATH_INFO: `/v3/projects/eeca1f77bb5c40858bab0b3c21a8da27` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.676207 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeca1f77bb5c40858bab0b3c21a8da27)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:25.678176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:25.729056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeca1f77bb5c40858bab0b3c21a8da27', 'request_id': 'req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.735689 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeca1f77bb5c40858bab0b3c21a8da27', 'request_id': 'req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.741731 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeca1f77bb5c40858bab0b3c21a8da27', 'request_id': 'req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.754704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] The token cache is being invalidate because project eeca1f77bb5c40858bab0b3c21a8da27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:25.754985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.755627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.757275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1355/2715] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:25 2022] DELETE /identity/v3/projects/eeca1f77bb5c40858bab0b3c21a8da27 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:25.761735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:25.771718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b281bb-d3c0-403a-83b6-07f1551ed787 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:25.779924 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:25.836400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:25.837285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.837563 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.837835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] PATH_INFO: `/v3/users/7b9341b44f8e4adc8e4984232e66d4b9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.839035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9341b44f8e4adc8e4984232e66d4b9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:25.841204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:25.891981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9341b44f8e4adc8e4984232e66d4b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.893076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9341b44f8e4adc8e4984232e66d4b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.900681 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9341b44f8e4adc8e4984232e66d4b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.913536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9341b44f8e4adc8e4984232e66d4b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.914198 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c4a8a6a-0352-4145-9749-b6f2f00f10dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9341b44f8e4adc8e4984232e66d4b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:25.928498 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1361/2716] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:25 2022] DELETE /identity/v3/users/7b9341b44f8e4adc8e4984232e66d4b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:26.223791 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.226077 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.241295 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8a786-4ca5-4daa-a65a-f0d47de0788c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.287909 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:26.308719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.309733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.310033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.310303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] PATH_INFO: `/v3/projects/6ade336fb23f4c2c9efca7902ece85e2` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.311550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ade336fb23f4c2c9efca7902ece85e2)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.313484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.360035 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ade336fb23f4c2c9efca7902ece85e2', 'request_id': 'req-6897ef18-0910-4f1d-8d70-f608d27a9dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.368796 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ade336fb23f4c2c9efca7902ece85e2', 'request_id': 'req-6897ef18-0910-4f1d-8d70-f608d27a9dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.375005 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ade336fb23f4c2c9efca7902ece85e2', 'request_id': 'req-6897ef18-0910-4f1d-8d70-f608d27a9dae'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.389816 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] The token cache is being invalidate because project 6ade336fb23f4c2c9efca7902ece85e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:26.390230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.390933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6897ef18-0910-4f1d-8d70-f608d27a9dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.393094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1356/2717] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:26 2022] DELETE /identity/v3/projects/6ade336fb23f4c2c9efca7902ece85e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:26.398215 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.398704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.398801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.416993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:26.418088 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.482437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1362/2718] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:26.490578 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.490941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.491245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.511168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:26.512601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.521603 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1357/2719] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:26.526200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.536640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34291-272c-4018-83ff-ffbdd618a751 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.542504 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.543312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.543631 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.543908 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.544632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:26.544940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.546578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.558178 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1363/2720] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:26.563468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.577177 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa11dc9-b5d8-40ac-b049-34ea2a8bc1e1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.583073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.583741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.584020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.584287 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.584978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.586910 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.617844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1358/2721] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:26.623414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.638779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23bc26-c573-445e-a585-e78b9ab16f4c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.653589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:26.700850 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.701521 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.701798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.702068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.702755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.704707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.727244 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1364/2722] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:26.731950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.747439 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4f35-7082-4c21-88e8-4fb1adfd4171 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.753171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.753828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.754104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.754371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.755226 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.756881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.769151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1359/2723] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:26.774047 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.785894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9aed-7324-43e8-86cf-da8520912fff admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.791475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.792177 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.792461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.792764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.793742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.795355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8884-f343-4b49-9b81-25757dbdde07 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.805795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1365/2724] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:26.810556 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.824299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26fa2-6618-483d-9537-95b341b01238 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.833371 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.834663 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.835066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.835414 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] PATH_INFO: `/v3/projects/a8f998095f03474b833b392e1f24f4ae/users/d755d9f5364d41ae9d4b0d04d5e3ba21/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.853926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f998095f03474b833b392e1f24f4ae, user_id=d755d9f5364d41ae9d4b0d04d5e3ba21, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.856895 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.874594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1360/2725] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:26 2022] PUT /identity/v3/projects/a8f998095f03474b833b392e1f24f4ae/users/d755d9f5364d41ae9d4b0d04d5e3ba21/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:26.885956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.886245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.886690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.916104 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] MFA Rules not processed for user `d755d9f5364d41ae9d4b0d04d5e3ba21`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:26.917790 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.991998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1366/2726] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:26.996690 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.057911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558c45-1089-44d9-b8c2-de027f006a30 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.063466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.064162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.064444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.064715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.065406 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.067343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.078151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:27.102567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1361/2727] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:27.107262 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.118700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465de-3851-425b-80f1-fd29bbf4cf14 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.185685 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.186345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.186623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.186896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.187668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.189578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.211176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1367/2728] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:27 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:27.215508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.226349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9faab-a28d-4171-b5e4-a3328338b883 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.231732 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.232390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.232670 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.232992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.233718 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.235338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.245818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1362/2729] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:27.249951 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.260412 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5704-e039-41fe-aacc-778a084a085b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.266260 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.266960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.267212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.268489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.268671 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.270279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bad0-243f-4288-9976-8cfb2350300a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.281423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1368/2730] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:27.285582 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.295862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b26c-6858-4121-b1f5-54a4f223cb14 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.300593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.301481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.301760 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.302033 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] PATH_INFO: `/v3/projects/d576d0712e58488d97a37f302e795d62/users/b42aeb327aec4c2b844d03bfa3b93a6a/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.317625 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d576d0712e58488d97a37f302e795d62, user_id=b42aeb327aec4c2b844d03bfa3b93a6a, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.320311 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.335579 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1363/2731] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:27 2022] PUT /identity/v3/projects/d576d0712e58488d97a37f302e795d62/users/b42aeb327aec4c2b844d03bfa3b93a6a/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:27.346672 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.347024 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.347388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.358009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:27.381842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] MFA Rules not processed for user `b42aeb327aec4c2b844d03bfa3b93a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:27.383070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:27.459143 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1369/2732] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:27.465397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.535832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0422ff-3317-4c86-b0ec-5339ac18f24a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.540930 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.541783 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.541994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.542093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.542868 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.544857 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.577319 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1364/2733] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:27 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:27.581512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.595895 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874ccd-21e2-4051-96f4-80a54c51826c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.665785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.666746 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.667279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.667729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.668535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.672652 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.704261 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1370/2734] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:27 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:27.709354 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.722260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d5eb-a8c1-4892-a835-edd4a4043178 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.727828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.728491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.728741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.729014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.729769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.731482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.742391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1365/2735] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:27.746715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.757296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8f97-342e-4617-9705-e9589a043b3e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.763145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.764074 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.764356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.764633 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] PATH_INFO: `/v3/projects/15d233558ecd4dc49d56318500854cb3/users/8a23a1af35ee4b30a121a595fdb385a0/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.781304 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d233558ecd4dc49d56318500854cb3, user_id=8a23a1af35ee4b30a121a595fdb385a0, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.784210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.799707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1371/2736] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:27 2022] PUT /identity/v3/projects/15d233558ecd4dc49d56318500854cb3/users/8a23a1af35ee4b30a121a595fdb385a0/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:27.803899 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.817985 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b197a-8259-4d1e-a3d2-5ea7b99a90a9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.885777 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.886640 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.886875 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.887171 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.887907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.889552 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623228-c311-4fb1-aea0-c32980381e30 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.899823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1366/2737] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:27.904421 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.914847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721747-91b3-4468-a35d-7516cd45f550 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.920109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.920989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.921267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.921535 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] PATH_INFO: `/v3/projects/15d233558ecd4dc49d56318500854cb3/users/8a23a1af35ee4b30a121a595fdb385a0/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.923590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d233558ecd4dc49d56318500854cb3, user_id=8a23a1af35ee4b30a121a595fdb385a0, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.926234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.937355 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1372/2738] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:27 2022] PUT /identity/v3/projects/15d233558ecd4dc49d56318500854cb3/users/8a23a1af35ee4b30a121a595fdb385a0/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:27.948110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.948393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.948717 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.980991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] MFA Rules not processed for user `8a23a1af35ee4b30a121a595fdb385a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:27.982095 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:27.994748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:28.054656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1367/2739] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:28.066375 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:28.068308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:28.123507 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:28.129923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d6af0-12e5-4ce5-aa0c-1f7297cf69dd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:28.133927 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:28.134615 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:28.134894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:28.135157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:28.144861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:28.146308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:28.156519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1373/2740] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:28.214057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:28.215727 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:28.228829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0f6a0-0c66-4efe-92b0-0fcd73b61aa2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:28.233253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:28.233841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:28.234146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:28.234420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:28.294152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:28.295664 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59bf47-a1b2-4ecf-9d87-7fbd001c6a4a service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:28.304753 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1368/2741] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:31.213693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.280307 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3b42-1b45-4855-b044-80ee5957fe71 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.285783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.286664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.286947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.287218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] PATH_INFO: `/v3/users/d755d9f5364d41ae9d4b0d04d5e3ba21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.288531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d755d9f5364d41ae9d4b0d04d5e3ba21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.290470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.345961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd755d9f5364d41ae9d4b0d04d5e3ba21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.346728 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd755d9f5364d41ae9d4b0d04d5e3ba21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.355050 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd755d9f5364d41ae9d4b0d04d5e3ba21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.366980 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd755d9f5364d41ae9d4b0d04d5e3ba21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.367774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd755d9f5364d41ae9d4b0d04d5e3ba21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.382987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1374/2742] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:31 2022] DELETE /identity/v3/users/d755d9f5364d41ae9d4b0d04d5e3ba21 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:31.387652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.388151 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.388250 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.407584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:31.408821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:31.473285 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1369/2743] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:31.486781 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.488279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:31.545376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3506b-35d1-416e-b4cb-75e86429bee1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.549451 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.550101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.550368 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.550637 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.565896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.568324 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.582750 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1375/2744] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:31.870419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.872211 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:31.885437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8b6e-443b-42aa-b5ce-74cef48ef7ee None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.890256 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.891157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.891653 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.891936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] PATH_INFO: `/v3/projects/a8f998095f03474b833b392e1f24f4ae` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.893500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f998095f03474b833b392e1f24f4ae)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.895622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.942943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:31.946839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f998095f03474b833b392e1f24f4ae', 'request_id': 'req-4e3d10ca-721f-4334-9707-cd1335667e81'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.953196 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f998095f03474b833b392e1f24f4ae', 'request_id': 'req-4e3d10ca-721f-4334-9707-cd1335667e81'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.959157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f998095f03474b833b392e1f24f4ae', 'request_id': 'req-4e3d10ca-721f-4334-9707-cd1335667e81'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.977136 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] The token cache is being invalidate because project a8f998095f03474b833b392e1f24f4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:31.977425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.978161 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:31.979881 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1370/2745] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:31 2022] DELETE /identity/v3/projects/a8f998095f03474b833b392e1f24f4ae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:31.985325 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.995270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cb885-7720-463b-a474-e0692d52711a service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.004415 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:32.071227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.072144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.072428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.072692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] PATH_INFO: `/v3/users/b42aeb327aec4c2b844d03bfa3b93a6a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.073984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42aeb327aec4c2b844d03bfa3b93a6a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.075959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.126647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42aeb327aec4c2b844d03bfa3b93a6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.127329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42aeb327aec4c2b844d03bfa3b93a6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.135599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42aeb327aec4c2b844d03bfa3b93a6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.153993 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42aeb327aec4c2b844d03bfa3b93a6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.154990 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42aeb327aec4c2b844d03bfa3b93a6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.171776 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1376/2746] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:31 2022] DELETE /identity/v3/users/b42aeb327aec4c2b844d03bfa3b93a6a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:32.471861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:32.473485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:32.487943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d10ca-721f-4334-9707-cd1335667e81 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.547631 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.548543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.548814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.549078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] PATH_INFO: `/v3/projects/d576d0712e58488d97a37f302e795d62` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.550332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d576d0712e58488d97a37f302e795d62)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.552310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.604617 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd576d0712e58488d97a37f302e795d62', 'request_id': 'req-5ae1445d-e7e2-4357-9e8a-abeb289458fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.610698 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd576d0712e58488d97a37f302e795d62', 'request_id': 'req-5ae1445d-e7e2-4357-9e8a-abeb289458fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.616891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd576d0712e58488d97a37f302e795d62', 'request_id': 'req-5ae1445d-e7e2-4357-9e8a-abeb289458fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.630907 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] The token cache is being invalidate because project d576d0712e58488d97a37f302e795d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:32.631217 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.631940 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.633518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1371/2747] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:32 2022] DELETE /identity/v3/projects/d576d0712e58488d97a37f302e795d62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:32.637610 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:32.639175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:32.653435 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c41d-13ca-43bd-9e37-05094fca0a73 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.711003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.711923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.712203 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.712476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] PATH_INFO: `/v3/users/8a23a1af35ee4b30a121a595fdb385a0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.713753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a23a1af35ee4b30a121a595fdb385a0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.715722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.755562 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:32.769247 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a23a1af35ee4b30a121a595fdb385a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.769890 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a23a1af35ee4b30a121a595fdb385a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.780063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a23a1af35ee4b30a121a595fdb385a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.793918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a23a1af35ee4b30a121a595fdb385a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.794648 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-57c0732f-7d97-4097-88e6-966e04d47880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a23a1af35ee4b30a121a595fdb385a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:32.809918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1377/2748] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:32 2022] DELETE /identity/v3/users/8a23a1af35ee4b30a121a595fdb385a0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:33.105496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.106950 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:33.119660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1445d-e7e2-4357-9e8a-abeb289458fd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.178383 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.179029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.179309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.179968 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] PATH_INFO: `/v3/projects/15d233558ecd4dc49d56318500854cb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.181056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d233558ecd4dc49d56318500854cb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.183210 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.189703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:33.232352 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d233558ecd4dc49d56318500854cb3', 'request_id': 'req-1d28f149-59e4-423d-aebc-b95a6e388878'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:33.238473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d233558ecd4dc49d56318500854cb3', 'request_id': 'req-1d28f149-59e4-423d-aebc-b95a6e388878'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:33.243975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d233558ecd4dc49d56318500854cb3', 'request_id': 'req-1d28f149-59e4-423d-aebc-b95a6e388878'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:33.259276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] The token cache is being invalidate because project 15d233558ecd4dc49d56318500854cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:33.259592 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:33.260329 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d28f149-59e4-423d-aebc-b95a6e388878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:33.261992 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1372/2749] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:33 2022] DELETE /identity/v3/projects/15d233558ecd4dc49d56318500854cb3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:33.268846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.269127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.269397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.287987 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:33.289179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:33.354115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1378/2750] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:33.423091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.423379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.423658 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.446404 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:33.447668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:33.457982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1373/2751] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:33.464238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.475343 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9943-2e9a-45c6-9825-87c7e1168cf3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.480791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.481446 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.481726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.481998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.482725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:33.483030 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.484667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.497558 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1379/2752] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:54:33.503687 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.513357 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31b71-946e-49d7-94d3-ef8548f5d4f2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.520100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.520953 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.521099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.521279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.521966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.523923 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.553186 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1374/2753] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:33 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:33.559840 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.573217 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4b913-f07d-4a31-81fc-7cf1c0d388cf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.636339 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.636937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.637214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.637484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.638183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.640145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.665200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1380/2754] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:33 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:33.669396 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.680530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f994e7-03e0-485e-804e-0869713bbc68 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.685897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.686566 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.686844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.687122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.687897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.689567 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.701501 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1375/2755] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:33.705666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.716258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d42e8b-9b2b-4860-ae4f-d4f2b3ddc04f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.722099 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.722808 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.723085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.723358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.724126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.725743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96be93-036d-4b00-9391-b0398bb946b0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.736807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1381/2756] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:33.741260 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.751767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336015-92a4-42b9-9a12-0243e3386e1a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:33.756972 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:33.757849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.758121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.758390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] PATH_INFO: `/v3/projects/a2edf4adeb8e43cdb9dd4831d9db53af/users/c2311d4e9e0243f19963d728288eec6c/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.775485 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2edf4adeb8e43cdb9dd4831d9db53af, user_id=c2311d4e9e0243f19963d728288eec6c, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:33.778399 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:33.796121 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1376/2757] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:33 2022] PUT /identity/v3/projects/a2edf4adeb8e43cdb9dd4831d9db53af/users/c2311d4e9e0243f19963d728288eec6c/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:33.807889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:33.808176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:33.808450 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:33.836292 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] MFA Rules not processed for user `c2311d4e9e0243f19963d728288eec6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:33.837488 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:33.841644 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:33.910647 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1382/2758] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:33.926803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:33.928837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:33.996430 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beb889-13a6-4d06-af2e-dd29eaf1ced7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:34.000472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:34.001145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.001481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.001681 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.010864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:34.012353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eeda99-0181-4a9f-8e9a-8642401d9fcb service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:34.024152 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1377/2759] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:34.044524 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:34.116196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe4fb-9a1f-4867-949a-f89ac86c001b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:34.122332 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:34.123285 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.123636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.123950 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] PATH_INFO: `/v3/users/c2311d4e9e0243f19963d728288eec6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.126001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2311d4e9e0243f19963d728288eec6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:34.128279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:34.179100 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2311d4e9e0243f19963d728288eec6c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.179702 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2311d4e9e0243f19963d728288eec6c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.186438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2311d4e9e0243f19963d728288eec6c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.198116 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2311d4e9e0243f19963d728288eec6c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.198741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2311d4e9e0243f19963d728288eec6c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.211608 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1383/2760] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:34 2022] DELETE /identity/v3/users/c2311d4e9e0243f19963d728288eec6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:34.216243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.216536 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.216813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.236363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:34.237686 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:34.271332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:34.311813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1378/2761] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:34.321926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:34.323849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:34.359639 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:34.390978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd2f5-fe16-40d7-8048-86f38e15791c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:34.395481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:34.396149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.396428 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.396704 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.406237 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:34.407729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bba514-1f63-4bb1-a7fe-62d16f4de316 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:34.417796 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1384/2762] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:34.705069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:34.706773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:34.719418 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b984a-68ed-4aec-bb43-8b03c05c32b0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:34.725444 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:34.726299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.726589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.726833 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] PATH_INFO: `/v3/projects/a2edf4adeb8e43cdb9dd4831d9db53af` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.728218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2edf4adeb8e43cdb9dd4831d9db53af)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:34.730164 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:34.785104 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2edf4adeb8e43cdb9dd4831d9db53af', 'request_id': 'req-9ff6bf99-e431-4a1d-a929-f515ef3394da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.791865 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2edf4adeb8e43cdb9dd4831d9db53af', 'request_id': 'req-9ff6bf99-e431-4a1d-a929-f515ef3394da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.797608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2edf4adeb8e43cdb9dd4831d9db53af', 'request_id': 'req-9ff6bf99-e431-4a1d-a929-f515ef3394da'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.811677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] The token cache is being invalidate because project a2edf4adeb8e43cdb9dd4831d9db53af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:34.811965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.812588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ff6bf99-e431-4a1d-a929-f515ef3394da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:34.814333 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1379/2763] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:34 2022] DELETE /identity/v3/projects/a2edf4adeb8e43cdb9dd4831d9db53af => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:34.819491 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.820021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.820125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.839085 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:34.840318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:34.904741 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1385/2764] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:34.912874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.913163 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.913434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.932792 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:34.933994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:34.942784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1380/2765] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:34.947797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:34.963400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4a40-2014-4b3d-b6c0-f65adb1e5c50 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:34.972913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:34.973604 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:34.973888 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:34.974158 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:34.974894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:34.975200 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:34.976851 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:34.989183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1386/2766] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:34.993807 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.003661 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c1b17-13b0-4a2b-9ab2-71aadb51376e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.009473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.010125 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.010405 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.010679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.011375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.013351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.047820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1381/2767] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:34 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:35.053667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.064123 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e089a1-2763-42ca-8d54-c076d7468dce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.130690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.131361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.131684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.131960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.132670 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.137084 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.168249 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1387/2768] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:35 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:35.172709 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.183584 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d921-d6ac-44ba-96da-0514cb49ad61 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.188386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.189044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.189328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.189602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.190331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.192108 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.202591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1382/2769] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:35.208906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.224250 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca43729-b0c3-4d88-a70f-02d581f270d8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.233896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.234955 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.235427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.235882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.237061 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.239039 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0edf2-81a2-4c33-8dd4-7d6c4f67bbe3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.249686 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1388/2770] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:35.254872 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.265132 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8fce-d30f-4182-be05-c9c2ed8fa04c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.270835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.271762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.272044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.272317 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] PATH_INFO: `/v3/projects/7a4a0cd9d1524a1596776d6f8cdb2481/users/c09e560a42194b85940ccd4bcc6c14c0/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.287069 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4a0cd9d1524a1596776d6f8cdb2481, user_id=c09e560a42194b85940ccd4bcc6c14c0, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.289769 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.304590 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1383/2771] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:35 2022] PUT /identity/v3/projects/7a4a0cd9d1524a1596776d6f8cdb2481/users/c09e560a42194b85940ccd4bcc6c14c0/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:35.314753 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.315040 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.315314 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.344229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] MFA Rules not processed for user `c09e560a42194b85940ccd4bcc6c14c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:35.345477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:35.368735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:35.415062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1389/2772] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:35.426984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:35.429130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:35.493814 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:35.517066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30126d6-3d35-4137-9755-1dcd43109414 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:35.521331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b164dd7ea5b474d85d541ad7815f1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:35.521984 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:35.522269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:35.522546 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:35.531044 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:35.532532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac4842-12ec-4287-bcb1-1892deb953dd service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:35.541635 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1384/2773] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:54:45.410930 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=17 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:45.537596 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=11 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:57.425645 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:57.501532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d783-537d-43f1-9cf3-8efd1258d5c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:57.506371 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:57.507254 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:57.507573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:57.507841 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] PATH_INFO: `/v3/users/c09e560a42194b85940ccd4bcc6c14c0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:57.509106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09e560a42194b85940ccd4bcc6c14c0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:57.511139 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:57.574144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09e560a42194b85940ccd4bcc6c14c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:57.574824 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09e560a42194b85940ccd4bcc6c14c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:57.582849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09e560a42194b85940ccd4bcc6c14c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:57.596065 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09e560a42194b85940ccd4bcc6c14c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:57.596849 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09e560a42194b85940ccd4bcc6c14c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:57.613010 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1390/2774] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:54:57 2022] DELETE /identity/v3/users/c09e560a42194b85940ccd4bcc6c14c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:57.619335 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:57.619919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:57.620056 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:57.638126 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:57.639325 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:57.698935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1385/2775] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:57.710620 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:57.712370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:57.777326 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9a58-64cd-4a40-b721-89a251e3d055 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:57.782692 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:57.783364 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:57.783675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:57.783949 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:57.795817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:57.797275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fee34-80f1-4fcc-b19b-8d7e0d73f410 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:57.806920 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1391/2776] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:58.090918 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.092581 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:58.107269 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6b7a-ba13-41d6-8434-5a8ed6274bc7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.115003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.116726 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.117208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.117490 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] PATH_INFO: `/v3/projects/7a4a0cd9d1524a1596776d6f8cdb2481` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.118888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4a0cd9d1524a1596776d6f8cdb2481)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.121275 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.178073 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4a0cd9d1524a1596776d6f8cdb2481', 'request_id': 'req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:58.185198 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4a0cd9d1524a1596776d6f8cdb2481', 'request_id': 'req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:58.191386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4a0cd9d1524a1596776d6f8cdb2481', 'request_id': 'req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:58.210292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] The token cache is being invalidate because project 7a4a0cd9d1524a1596776d6f8cdb2481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:58.210647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:58.211712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e9d4c05-4d25-4b19-954e-eb9b98fb77c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:58.214637 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1386/2777] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:54:58 2022] DELETE /identity/v3/projects/7a4a0cd9d1524a1596776d6f8cdb2481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:58.219979 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.220267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.220539 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.239551 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:58.240729 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:58.258678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:58.305783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1392/2778] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:58.313849 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.314137 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.314436 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.333926 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:58.335180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:58.343944 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1387/2779] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:58.348585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.359287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe121-3a6a-4c7a-9fc5-53077148aeb3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.365460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.366135 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.366417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.366687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.367457 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:58.367798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.369536 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.385271 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1393/2780] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:58.389823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.400349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62d6ec-cf7c-405d-a281-97976b0e5455 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.406917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.407764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.408235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.408554 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.409179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.411423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.451924 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1388/2781] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:54:58 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:58.456414 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.467617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae97d-4a09-4a5a-9969-0782d7891bc6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.548454 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.549119 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.549404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.549678 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.550365 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.552481 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.575309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1394/2782] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:54:58 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:58.579644 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.590411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fc68-75a6-473a-b698-feebece32a89 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.595369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.596071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.596346 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.596615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.597345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.598988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.609407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1389/2783] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:58.613703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.624977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5bce0-651e-48ae-994e-a343b2233de3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.630597 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.631268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.631569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.631848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.632579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.634194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88f4df-cdf6-43af-838b-8bc0acb0b756 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.645351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1395/2784] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:58.650810 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.661402 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316360d-778f-45bd-b4c4-a26e8050d611 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.666524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.667472 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.667805 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.668102 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] PATH_INFO: `/v3/projects/33b0c6f982c3403a89906977ffb05bc3/users/e9ae772c030c4944a5e7aabb745f0ea7/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.684007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b0c6f982c3403a89906977ffb05bc3, user_id=e9ae772c030c4944a5e7aabb745f0ea7, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.686627 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.702482 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1390/2785] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:54:58 2022] PUT /identity/v3/projects/33b0c6f982c3403a89906977ffb05bc3/users/e9ae772c030c4944a5e7aabb745f0ea7/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:58.713712 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ad179-cebd-4c3f-9dfe-78702d033f6e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.714083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ad179-cebd-4c3f-9dfe-78702d033f6e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.714410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ad179-cebd-4c3f-9dfe-78702d033f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.742961 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3a0ad179-cebd-4c3f-9dfe-78702d033f6e None None] MFA Rules not processed for user `e9ae772c030c4944a5e7aabb745f0ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:58.744688 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3a0ad179-cebd-4c3f-9dfe-78702d033f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:58.813698 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1396/2786] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:58.825696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:58.827825 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:58.843569 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:58.889286 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca978-80cd-494e-9447-5d18cad3e16f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:58.893509 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:58.894157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:58.894440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:58.894712 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:58.904054 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:58.905512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:58.914434 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1391/2787] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:00.292581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:00.293136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:00.293136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:00.313128 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] MFA Rules not processed for user `e9ae772c030c4944a5e7aabb745f0ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:00.314320 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:00.322785 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1397/2788] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:08.910413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=21 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:09.263091 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:09.264683 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:09.353469 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cf04-6a76-47eb-b676-5d06e13cf17f service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:09.359129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:09.359809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:09.360704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:09.360704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:09.362949 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:09.375203 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:09.376851 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2d1d-de13-40ed-bfa2-803fa0c89cd0 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:09.387888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1392/2789] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:10.307001 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:14.178962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:14.181805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:14.203509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894cab8-8741-4fdb-9bba-4e706ce13473 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:14.211301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b77d3d3a1345f98194174676e35873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:14.212341 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:14.212797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:14.213243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:14.216400 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:14.308430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:14.310204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:14.321537 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1398/2790] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:15.638614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a329-e64a-4932-8cea-97e536519c10 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:15.639142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a329-e64a-4932-8cea-97e536519c10 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:15.639142 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a329-e64a-4932-8cea-97e536519c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:15.699277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c6e2a329-e64a-4932-8cea-97e536519c10 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:15.700538 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c6e2a329-e64a-4932-8cea-97e536519c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:15.774761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1393/2791] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:15.822667 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:15.824171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:15.919733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224282-9cf1-480d-8c65-c9ebb8435a68 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:15.925775 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:15.926471 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:15.926752 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:15.927026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:15.937956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:15.939617 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:15.949257 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1399/2792] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:16.479878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d88-b750-4a45-82f9-d6c4364867b9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:16.480172 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d88-b750-4a45-82f9-d6c4364867b9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:16.480453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d88-b750-4a45-82f9-d6c4364867b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:16.499602 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-40049d88-b750-4a45-82f9-d6c4364867b9 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:16.500822 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-40049d88-b750-4a45-82f9-d6c4364867b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:16.509571 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1394/2793] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:16.522291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:16.533668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de417cd-50a8-4ff5-a602-b176d44862f0 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:16.539305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:16.540096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:16.540423 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:16.540707 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:16.549279 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:16.550912 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:16.559827 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1400/2794] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:55:16.764662 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf48e-45f5-4075-8e12-175546d57136 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:16.765157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf48e-45f5-4075-8e12-175546d57136 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:16.765274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf48e-45f5-4075-8e12-175546d57136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:16.784704 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8bddf48e-45f5-4075-8e12-175546d57136 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:16.785908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8bddf48e-45f5-4075-8e12-175546d57136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:16.794541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1395/2795] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 26 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:16.806766 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:16.817623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc0c8-5b93-447f-96a9-be1bd287b67d service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:16.823035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:16.823703 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:16.824003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:16.824277 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:16.832477 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:16.834169 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:16.842881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1401/2796] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:17.184208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:17.184468 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:17.184764 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:17.202448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] MFA Rules not processed for user `3770d9f2375a4c9aa2b5b514d1be39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:17.203674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:17.211018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1396/2797] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 26 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:17.222982 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:17.234405 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb457f6-f635-41f1-b88e-f0f60a665374 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:17.240853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd6a83714a4d88ae001e7ed462fa86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:17.241499 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:17.241788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:17.242058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:17.250783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:17.252430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156bc16-64b7-40f9-9f79-c40a1572e8d7 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:17.261064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1402/2798] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 26 12:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:19.391481 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:19.427813 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:19.474919 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9a39-e482-4034-8e47-32904c4f9a36 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:19.480425 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:19.481310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:19.481589 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:19.481861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] PATH_INFO: `/v3/users/e9ae772c030c4944a5e7aabb745f0ea7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:19.483162 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ae772c030c4944a5e7aabb745f0ea7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:19.485178 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:19.543197 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ae772c030c4944a5e7aabb745f0ea7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:19.543960 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ae772c030c4944a5e7aabb745f0ea7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:19.544677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ae772c030c4944a5e7aabb745f0ea7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:19.557858 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ae772c030c4944a5e7aabb745f0ea7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:19.565107 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ae772c030c4944a5e7aabb745f0ea7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:19.579723 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1397/2799] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:55:19 2022] DELETE /identity/v3/users/e9ae772c030c4944a5e7aabb745f0ea7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:19.584689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:19.585218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:19.585218 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:19.602835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:19.604043 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:19.630272 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:19.677002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1403/2800] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:19.687053 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:19.688708 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:19.753339 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026037c-ea3d-44c3-ad32-752cf1b7ac27 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:19.757167 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:19.757828 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:19.758111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:19.758379 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:19.767568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:19.769411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298933db-c901-4f30-9047-8b656ff6d1ce service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:19.779951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1398/2801] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:19.969938 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:19.971485 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:19.985800 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a36cf-910a-41b7-afa0-072a913a4940 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:19.991162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:19.992086 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:19.992440 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:19.992819 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] PATH_INFO: `/v3/projects/33b0c6f982c3403a89906977ffb05bc3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:19.994605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b0c6f982c3403a89906977ffb05bc3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:19.996580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:20.048033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b0c6f982c3403a89906977ffb05bc3', 'request_id': 'req-92668465-b9df-49c9-902e-713e17c5eb67'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:20.054517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b0c6f982c3403a89906977ffb05bc3', 'request_id': 'req-92668465-b9df-49c9-902e-713e17c5eb67'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:20.062540 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b0c6f982c3403a89906977ffb05bc3', 'request_id': 'req-92668465-b9df-49c9-902e-713e17c5eb67'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:20.077248 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] The token cache is being invalidate because project 33b0c6f982c3403a89906977ffb05bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:20.077531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:20.078154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:20.079763 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1404/2802] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:55:19 2022] DELETE /identity/v3/projects/33b0c6f982c3403a89906977ffb05bc3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:29.775669 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:30.074282 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:30.710815 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.711099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.711369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.730685 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] MFA Rules not processed for user `eddc5d9ac2a74507bca19e06f0051ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:30.731911 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:30.792677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1399/2803] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:31.119614 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:31.122199 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:31.190595 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668465-b9df-49c9-902e-713e17c5eb67 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:31.194607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:31.195323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:31.195601 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:31.195835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:31.197780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:31.215235 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:31.217420 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:31.230493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1405/2804] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:55:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:40.785189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=25 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:41.225142 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=26 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:12.305083 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:12.306969 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:12.389420 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109010-977f-4e22-933f-2c916e65fc65 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:12.395705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:12.396382 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:12.396665 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:12.396941 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:12.398763 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:12.411415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:12.413094 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:12.423310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1400/2805] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:18.431196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:18.432807 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:18.444152 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f21-98bb-492f-af0d-88050b95a9e8 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:18.449072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:18.449716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:18.449998 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:18.450268 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:18.452646 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:18.532321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:18.533797 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:18.544027 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1406/2806] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:21.822491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:21.824153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:21.843223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d53d1-dd5b-451a-9708-4909679709e8 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:21.848294 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:21.849299 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:21.849619 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:21.849978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] PATH_INFO: `/v3/users/eddc5d9ac2a74507bca19e06f0051ae1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:21.851591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddc5d9ac2a74507bca19e06f0051ae1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:21.853915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:21.903959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddc5d9ac2a74507bca19e06f0051ae1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:21.904974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddc5d9ac2a74507bca19e06f0051ae1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:21.905577 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddc5d9ac2a74507bca19e06f0051ae1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:21.918390 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddc5d9ac2a74507bca19e06f0051ae1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:21.926002 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9ec78201-2028-4ab9-a2bc-e32d1f9c64d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddc5d9ac2a74507bca19e06f0051ae1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:21.941064 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1401/2807] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:21 2022] DELETE /identity/v3/users/eddc5d9ac2a74507bca19e06f0051ae1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:22.129410 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.139966 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632636b-5be0-4e99-9c62-a32ee8da6939 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.204573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.206664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.206664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.206900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] PATH_INFO: `/v3/projects/93d5b6bba38643bfb76f083e230b3d22` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.208094 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d5b6bba38643bfb76f083e230b3d22)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.210389 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.260323 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d5b6bba38643bfb76f083e230b3d22', 'request_id': 'req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:22.266607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d5b6bba38643bfb76f083e230b3d22', 'request_id': 'req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:22.273113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d5b6bba38643bfb76f083e230b3d22', 'request_id': 'req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:22.286731 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] The token cache is being invalidate because project 93d5b6bba38643bfb76f083e230b3d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:22.287026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:22.287774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c615facc-4efa-4cd9-ba3d-b98ff63b7ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:22.289605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1407/2808] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:22 2022] DELETE /identity/v3/projects/93d5b6bba38643bfb76f083e230b3d22 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:22.294677 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.294963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.295243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.316668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:22.318109 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:22.387392 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1402/2809] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:22.396159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.396447 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.396844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.416643 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:22.417914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:22.426923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1408/2810] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:22.431507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.436518 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:22.443235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59caa5-a0c7-47f2-b039-498725cd5c7c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.449514 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.450181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.450463 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.450738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.451473 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:57:22.451823 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.453484 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.465784 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1403/2811] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:57:22.470212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.480337 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2bbc-f4fe-4343-9ef1-c1fc66d6a385 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.486058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.486717 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.487003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.487297 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.488023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.489962 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.504842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:22.519406 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1409/2812] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:22.524101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.534893 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11593238-6238-4ac2-9954-986ad565e1ec admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.599457 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.600583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.600831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.601114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.601809 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.603839 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.633129 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1404/2813] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:22.637430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.649376 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5f08-98c7-4caf-8add-3eced7a64f35 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.654956 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.655675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.655957 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.656229 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.657003 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.658621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.670427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1410/2814] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:22.674700 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.685433 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e168-0d46-466d-9496-68497f67e17d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.691158 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.691853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.692124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.692388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.693114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.694888 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b5478-a24c-4df1-9425-735eb86b9847 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.705757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1405/2815] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:22.710212 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.723487 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cace8-ccdc-47d3-9ed1-8fa389395715 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.730252 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.731404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.731735 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.732012 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] PATH_INFO: `/v3/projects/e43464d432ff4f678d49285c7cb71f9b/users/bff98a5a19d54bb693f627f04e5423f0/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.748693 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43464d432ff4f678d49285c7cb71f9b, user_id=bff98a5a19d54bb693f627f04e5423f0, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.751388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.765388 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1411/2816] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:22 2022] PUT /identity/v3/projects/e43464d432ff4f678d49285c7cb71f9b/users/bff98a5a19d54bb693f627f04e5423f0/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:22.778519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.778752 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.779023 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.808524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] MFA Rules not processed for user `bff98a5a19d54bb693f627f04e5423f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:22.809736 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:22.876153 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1406/2817] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:22.880859 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:22.945529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5fcbe-d7d8-47e7-ad7c-67044b242eff admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:22.952241 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:22.953125 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:22.953476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:22.953817 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:22.954711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:22.956783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:22.984914 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1412/2818] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:22.989223 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.000991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23cefd-02ea-467e-baab-7e0b28d00bde None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.061326 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:23.068808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.069500 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.069928 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.070202 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.070898 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.073180 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.096621 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1407/2819] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:22 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:23.100594 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.112706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556c61-9bb8-471a-b9c6-34acc390b845 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.118060 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.118733 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.119032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.119329 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.120097 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.121700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.132580 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1413/2820] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:23.137499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.148532 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3b3e-cd92-49fd-b52f-d815c8d894e2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.153389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.154274 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.154546 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.154819 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] PATH_INFO: `/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93/users/1122982b4f5f4f5fbb4a5c9d8de04778/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.170966 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a810c869194c0c8a0b6e1bf512bb93, user_id=1122982b4f5f4f5fbb4a5c9d8de04778, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.173694 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.188065 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1408/2821] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:23 2022] PUT /identity/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93/users/1122982b4f5f4f5fbb4a5c9d8de04778/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:23.192309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.204105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34b5f-b788-44ed-944a-7671cf16341d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.280947 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.281624 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.281913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.282183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.282942 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.284664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1891a-8e7f-4a9d-87e9-e3df798dcd57 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.295470 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1414/2822] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:23.299882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.310593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ea5a-7503-4a88-99ea-d184ba7255ce admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.315981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.316786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.317058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.317380 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] PATH_INFO: `/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93/users/1122982b4f5f4f5fbb4a5c9d8de04778/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.319782 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a810c869194c0c8a0b6e1bf512bb93, user_id=1122982b4f5f4f5fbb4a5c9d8de04778, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.322442 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.339093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1409/2823] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:23 2022] PUT /identity/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93/users/1122982b4f5f4f5fbb4a5c9d8de04778/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:23.349394 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.349683 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.350110 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.378038 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] MFA Rules not processed for user `1122982b4f5f4f5fbb4a5c9d8de04778`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:23.379626 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:23.406822 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:23.470395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1415/2824] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:23.482169 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:23.484018 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:23.544594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ae87-c8e1-42e1-ae2d-0b99cc392c37 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:23.548905 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:23.549495 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:23.549802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:23.550078 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:23.559428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:23.560952 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa319c-f488-4cd4-bbe6-686c5bf2b7b4 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:23.570351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1410/2825] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:24.005137 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:24.074159 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1fa7d-038e-4cbb-862b-713b8ff1dfb4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:24.079066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:24.080005 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:24.080276 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:24.080517 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] PATH_INFO: `/v3/users/bff98a5a19d54bb693f627f04e5423f0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:24.081744 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff98a5a19d54bb693f627f04e5423f0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:24.083756 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:24.140072 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff98a5a19d54bb693f627f04e5423f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.140783 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff98a5a19d54bb693f627f04e5423f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.147929 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff98a5a19d54bb693f627f04e5423f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.159799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff98a5a19d54bb693f627f04e5423f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.160527 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff98a5a19d54bb693f627f04e5423f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.174664 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1416/2826] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:24 2022] DELETE /identity/v3/users/bff98a5a19d54bb693f627f04e5423f0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:24.179743 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:24.180245 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:24.180375 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:24.199739 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:24.200929 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:24.266212 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1411/2827] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:24.278438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:24.280179 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:24.324587 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:24.344303 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445f76-8636-442d-9843-e9cab9194a1c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:24.348163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:24.348814 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:24.349096 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:24.349393 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:24.358943 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:24.360658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:24.372370 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1417/2828] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:24.664583 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:24.666013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:24.681808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f975db4-c162-4e6d-8506-0463c1d39ad9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:24.687963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:24.689076 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:24.689423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:24.689762 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] PATH_INFO: `/v3/projects/e43464d432ff4f678d49285c7cb71f9b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:24.691388 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43464d432ff4f678d49285c7cb71f9b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:24.693403 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:24.739524 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:24.741026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43464d432ff4f678d49285c7cb71f9b', 'request_id': 'req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.749835 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43464d432ff4f678d49285c7cb71f9b', 'request_id': 'req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.756626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43464d432ff4f678d49285c7cb71f9b', 'request_id': 'req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.770719 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] The token cache is being invalidate because project e43464d432ff4f678d49285c7cb71f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:24.770999 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.771725 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.773576 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1412/2829] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:24 2022] DELETE /identity/v3/projects/e43464d432ff4f678d49285c7cb71f9b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:24.777892 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:24.788923 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da8139-8ec6-4051-b3a6-ae0019d46851 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:24.849981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:24.850959 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:24.851309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:24.851687 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] PATH_INFO: `/v3/users/1122982b4f5f4f5fbb4a5c9d8de04778` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:24.853185 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1122982b4f5f4f5fbb4a5c9d8de04778)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:24.855715 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:24.911882 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1122982b4f5f4f5fbb4a5c9d8de04778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.912798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1122982b4f5f4f5fbb4a5c9d8de04778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.920561 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1122982b4f5f4f5fbb4a5c9d8de04778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.933654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1122982b4f5f4f5fbb4a5c9d8de04778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.934894 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4021e95f-f81b-436f-a3f1-cb7d194cc49d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1122982b4f5f4f5fbb4a5c9d8de04778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:24.958069 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1418/2830] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:24 2022] DELETE /identity/v3/users/1122982b4f5f4f5fbb4a5c9d8de04778 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:25.473229 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:25.475391 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:25.496904 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd499-331d-4ed4-b170-b13b42ba1bd3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:25.559398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:25.560291 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.560594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.560861 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] PATH_INFO: `/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.562049 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a810c869194c0c8a0b6e1bf512bb93)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:25.564110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:25.613867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a810c869194c0c8a0b6e1bf512bb93', 'request_id': 'req-6284c8f1-1c5f-4089-a36a-d8d84623594e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:25.620738 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a810c869194c0c8a0b6e1bf512bb93', 'request_id': 'req-6284c8f1-1c5f-4089-a36a-d8d84623594e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:25.626411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a810c869194c0c8a0b6e1bf512bb93', 'request_id': 'req-6284c8f1-1c5f-4089-a36a-d8d84623594e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:25.639716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] The token cache is being invalidate because project f7a810c869194c0c8a0b6e1bf512bb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:25.640118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:25.640741 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6284c8f1-1c5f-4089-a36a-d8d84623594e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:25.642321 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1413/2831] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:25 2022] DELETE /identity/v3/projects/f7a810c869194c0c8a0b6e1bf512bb93 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:57:25.648395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.648886 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.649164 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.672026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:25.673573 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:25.728902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:25.739795 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1419/2832] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:25.749309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.749594 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.749866 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.774748 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:25.776264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:25.785520 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1414/2833] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:25.791238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:25.804721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fbe9f-ff6f-4516-9057-bee4e295c4d7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:25.810352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:25.811145 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.811404 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.811734 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.812549 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:57:25.812928 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:25.814805 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:25.829469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1420/2834] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:57:25.833975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:25.843916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdfcbd-b8a6-474e-aa21-5810537caad6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:25.848837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:25.849504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.849981 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.850110 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.850994 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:25.852990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:25.879491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1415/2835] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:25 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:25.883708 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:25.893995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44fea-d695-422d-bc32-aafb77027a8e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:25.952214 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:25.952913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.953258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.953528 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:25.954204 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:25.956195 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:25.978149 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1421/2836] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:25 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:25.982426 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:25.993238 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7680-aebc-4869-b410-75265a1864e0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:25.999353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:25.999353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:25.999656 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:25.999773 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.000493 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.002173 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.013660 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1416/2837] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:26.017893 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.029183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff890-b809-412d-8cab-3c21fbb4dc5b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.033960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.034629 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.034909 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.035183 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.035995 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.037761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94866b3-c3a5-44df-818b-81865dbb6b0a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.048157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1422/2838] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:26.054788 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.065852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb592c-5c22-480d-9aaf-fdf7fcd15ca6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.071296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.072253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.072530 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.072793 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] PATH_INFO: `/v3/projects/221018355f8941ab8a34174116a3a614/users/be14d5afb0824ea2bb1da6bc8495a355/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.090874 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221018355f8941ab8a34174116a3a614, user_id=be14d5afb0824ea2bb1da6bc8495a355, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.093612 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.108043 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1417/2839] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:26 2022] PUT /identity/v3/projects/221018355f8941ab8a34174116a3a614/users/be14d5afb0824ea2bb1da6bc8495a355/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:57:26.120948 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.121238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.121512 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.150889 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] MFA Rules not processed for user `be14d5afb0824ea2bb1da6bc8495a355`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:26.152070 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.219711 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1423/2840] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:26.224363 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.229254 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:26.298201 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e94d-e201-4255-b460-d48d2691db71 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.304601 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.305266 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.305548 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.305821 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.306531 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.308545 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.339411 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1418/2841] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:26.345372 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.359739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df24eca-9cd3-43f6-baac-decf220ae589 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.419954 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:26.436138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.436834 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.439861 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.440140 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.440952 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.444656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.472546 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1424/2842] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:26.473808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.484982 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2350e0-1546-4dbd-a36a-06831263d60f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.490103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.490761 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.491101 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.491374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.492277 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.493850 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.505443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1419/2843] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:26.510937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.523879 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179b43-11d0-40e2-86f7-ae7076b7d0ef admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.529853 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.530755 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.531035 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.531309 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] PATH_INFO: `/v3/projects/077410fb417a4b799c791246e41e084a/users/0a2dff0f36f44468ac40efede09c2985/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.547673 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077410fb417a4b799c791246e41e084a, user_id=0a2dff0f36f44468ac40efede09c2985, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.550353 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.564209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1425/2844] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:26 2022] PUT /identity/v3/projects/077410fb417a4b799c791246e41e084a/users/0a2dff0f36f44468ac40efede09c2985/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:26.569059 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.584860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a97b-9173-4833-802f-a7b9b7763304 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.650389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.651063 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.651334 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.651714 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.652466 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.654100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f4b1-0d11-4ceb-a614-cef587a42e60 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.665020 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1420/2845] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:26.669417 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.680461 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35845e-cf9b-4817-8cab-627e8560f317 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.685411 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.686310 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.686589 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.686862 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] PATH_INFO: `/v3/projects/077410fb417a4b799c791246e41e084a/users/0a2dff0f36f44468ac40efede09c2985/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.689017 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077410fb417a4b799c791246e41e084a, user_id=0a2dff0f36f44468ac40efede09c2985, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.691666 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.703189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1426/2846] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:26 2022] PUT /identity/v3/projects/077410fb417a4b799c791246e41e084a/users/0a2dff0f36f44468ac40efede09c2985/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:26.718190 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.718618 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.718961 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.749085 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] MFA Rules not processed for user `0a2dff0f36f44468ac40efede09c2985`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:26.750314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.819233 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:26.828413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1421/2847] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:26.842078 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.844346 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.908129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080de95-9db3-4980-b26c-91cc160a42b3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.912076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.912831 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.913113 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.913387 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.923105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.924579 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f56419-45fd-4911-ac90-b7ea35a96d84 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.934157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1427/2848] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:27.069050 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:27.132205 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3a3f-e5b4-4da9-b26c-23d4dbb88352 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:27.136864 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:27.137744 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:27.138019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:27.138292 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] PATH_INFO: `/v3/users/be14d5afb0824ea2bb1da6bc8495a355` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:27.139489 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be14d5afb0824ea2bb1da6bc8495a355)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:27.141465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:27.189395 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be14d5afb0824ea2bb1da6bc8495a355'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.190089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be14d5afb0824ea2bb1da6bc8495a355'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.190757 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be14d5afb0824ea2bb1da6bc8495a355'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.204200 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be14d5afb0824ea2bb1da6bc8495a355'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.211342 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be14d5afb0824ea2bb1da6bc8495a355'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.236746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1422/2849] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:27 2022] DELETE /identity/v3/users/be14d5afb0824ea2bb1da6bc8495a355 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:27.241675 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:27.241965 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:27.242238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:27.264136 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:27.265361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:27.333599 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1428/2850] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:27.344111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:27.345647 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:27.406465 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463435-a0a9-4ff7-9d57-a7f265c4a9d5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:27.410105 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:27.410751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:27.411029 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:27.411298 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:27.420491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:27.421936 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:27.431591 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1423/2851] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:27.714378 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:27.716898 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:27.730690 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ccd1e-f5ad-4a0f-a5cb-e8923b9dd746 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:27.735238 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:27.736150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:27.736377 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:27.736651 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] PATH_INFO: `/v3/projects/221018355f8941ab8a34174116a3a614` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:27.737985 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=221018355f8941ab8a34174116a3a614)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:27.740234 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:27.798352 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:27.803154 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221018355f8941ab8a34174116a3a614', 'request_id': 'req-47956595-484e-4042-b4d5-b4b69eb6a92a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.812076 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221018355f8941ab8a34174116a3a614', 'request_id': 'req-47956595-484e-4042-b4d5-b4b69eb6a92a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.818887 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221018355f8941ab8a34174116a3a614', 'request_id': 'req-47956595-484e-4042-b4d5-b4b69eb6a92a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.832738 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] The token cache is being invalidate because project 221018355f8941ab8a34174116a3a614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:27.833028 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.833669 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.835263 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1429/2852] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:27 2022] DELETE /identity/v3/projects/221018355f8941ab8a34174116a3a614 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:27.839786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:27.849302 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127c1d-6c7f-4ae0-b425-8ab9aceb74a7 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:27.867184 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:27.913384 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:27.914271 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:27.914549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:27.914818 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] PATH_INFO: `/v3/users/0a2dff0f36f44468ac40efede09c2985` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:27.916150 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2dff0f36f44468ac40efede09c2985)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:27.918118 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:27.967066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2dff0f36f44468ac40efede09c2985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.967947 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2dff0f36f44468ac40efede09c2985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.968676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2dff0f36f44468ac40efede09c2985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.981318 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2dff0f36f44468ac40efede09c2985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:27.988933 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-10fc4404-4a0c-41a0-9f7c-0d94f104e4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2dff0f36f44468ac40efede09c2985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.003774 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1424/2853] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:27 2022] DELETE /identity/v3/users/0a2dff0f36f44468ac40efede09c2985 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:28.283064 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.284845 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:28.301305 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956595-484e-4042-b4d5-b4b69eb6a92a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.370290 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.371161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.371430 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.371724 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] PATH_INFO: `/v3/projects/077410fb417a4b799c791246e41e084a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.372900 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=077410fb417a4b799c791246e41e084a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.374801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.421274 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077410fb417a4b799c791246e41e084a', 'request_id': 'req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.427642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077410fb417a4b799c791246e41e084a', 'request_id': 'req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.433452 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077410fb417a4b799c791246e41e084a', 'request_id': 'req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.446460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] The token cache is being invalidate because project 077410fb417a4b799c791246e41e084a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:28.446742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.447369 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d75279f8-a8d6-4da9-a63a-2ffe4451df4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:28.448978 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1430/2854] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:28 2022] DELETE /identity/v3/projects/077410fb417a4b799c791246e41e084a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:28.454026 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b048-6750-436b-bf51-748d9864a685 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.454313 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b048-6750-436b-bf51-748d9864a685 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.454615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b048-6750-436b-bf51-748d9864a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.472962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7239b048-6750-436b-bf51-748d9864a685 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:28.474146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7239b048-6750-436b-bf51-748d9864a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:28.537751 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1425/2855] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:28.546864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.547157 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.547434 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.567225 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:28.568489 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:28.578291 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1431/2856] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:28.583128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b048-6750-436b-bf51-748d9864a685 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.594345 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b048-6750-436b-bf51-748d9864a685 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.599990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.600733 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.601007 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.601279 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.602016 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:57:28.602309 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.603991 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.616797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1426/2857] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:57:28.620757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.630083 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f761-1162-466f-9170-ad62d02bc9a0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.635896 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.636567 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.636846 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.637153 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.637858 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.639977 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.670659 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1432/2858] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:28 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:28.675555 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.686550 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b751db3-a6c6-4191-ade4-13c879239996 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.715528 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:28.752679 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.753353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.753834 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.754114 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.754891 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.757356 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.779160 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1427/2859] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:28 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:28.785358 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.796106 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac11b-663a-45c8-9a72-d0827879758d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.801264 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.801931 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.802210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.802476 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.803259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.804922 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.815863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1433/2860] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:57:28.820443 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.831829 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d522e4-a283-4939-95b5-ef30cce7c03c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.838014 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.838705 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.839071 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.839327 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.840213 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.841988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df70687-fcdb-4193-a36b-1417928df893 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.859031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1428/2861] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:28.863907 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:28.875148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2910a4-0e35-4980-95c3-6467476aa6a4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:28.881171 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:28.882066 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.882345 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.882609 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] PATH_INFO: `/v3/projects/113606bf83374f5a98bbc92638416d92/users/ce7d64591a1949b697ef78147eb79066/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.899209 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=113606bf83374f5a98bbc92638416d92, user_id=ce7d64591a1949b697ef78147eb79066, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:28.901902 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:28.911925 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:28.922788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1434/2862] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:28 2022] PUT /identity/v3/projects/113606bf83374f5a98bbc92638416d92/users/ce7d64591a1949b697ef78147eb79066/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:28.929593 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09644b57-29d3-4459-b7d1-7c68626e4db1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:28.929885 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09644b57-29d3-4459-b7d1-7c68626e4db1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:28.930166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09644b57-29d3-4459-b7d1-7c68626e4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:28.948423 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-09644b57-29d3-4459-b7d1-7c68626e4db1 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:28.949636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-09644b57-29d3-4459-b7d1-7c68626e4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:29.021432 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1429/2863] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:29.034062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:29.036398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:29.109120 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3872a-3829-41bf-9846-d9d1b58e82ec admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:29.113374 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:29.114036 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:29.114318 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:29.114590 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:29.124545 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:29.126029 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:29.136333 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1435/2864] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:29.778360 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:29.780860 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:29.782667 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:29.825588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] MFA Rules not processed for user `ce7d64591a1949b697ef78147eb79066`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:29.827453 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:29.904516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1430/2865] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:29.909063 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:29.920034 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca460f-ef6b-42ee-8b2e-45936372a40a service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:29.924694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:29.925484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:29.925868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:29.926419 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:29.927115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:29.929474 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:29.958668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1436/2866] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:29 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:57:29.964990 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:29.981889 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63f1a-8cc4-4d12-8617-ae3e2f920845 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:30.018803 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:30.046227 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:30.046903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.047176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.047447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.048168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:30.050122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:30.070387 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1431/2867] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:29 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:57:30.074904 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:30.089025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6cb9-f152-4f96-874a-7b4e9fd2dbd1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:30.094251 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:30.094989 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.095306 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.095721 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.096502 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:30.098296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:30.110275 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1437/2868] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:30.114652 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:30.136837 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb189-d6bf-474c-90d8-89c15914164f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:30.143019 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:30.143934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.144241 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.144515 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] PATH_INFO: `/v3/projects/fd421f6664114d8d9c41769a7aa63243/users/fc5e3cbf1a144153b5ccf56b25915379/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.163862 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd421f6664114d8d9c41769a7aa63243, user_id=fc5e3cbf1a144153b5ccf56b25915379, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:30.167093 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:30.183300 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1432/2869] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:30 2022] PUT /identity/v3/projects/fd421f6664114d8d9c41769a7aa63243/users/fc5e3cbf1a144153b5ccf56b25915379/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:30.188196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:30.201497 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b74bf4-dd3b-4d1e-b130-2355537f8a79 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:30.259006 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:30.259779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.260109 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.260438 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.261256 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:30.263021 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bf370-dd05-40b0-bc1c-b56dbb07ea76 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:30.276189 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1438/2870] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:30.281096 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:30.292204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81ac2-f78b-4325-8394-5a132c400764 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:30.297099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:30.297978 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.298343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.298615 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] PATH_INFO: `/v3/projects/fd421f6664114d8d9c41769a7aa63243/users/fc5e3cbf1a144153b5ccf56b25915379/roles/9ea7741ab45842faa0bb474f4ee06ed4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.300697 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd421f6664114d8d9c41769a7aa63243, user_id=fc5e3cbf1a144153b5ccf56b25915379, role_id=9ea7741ab45842faa0bb474f4ee06ed4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:30.303470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:30.314568 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1433/2871] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:30 2022] PUT /identity/v3/projects/fd421f6664114d8d9c41769a7aa63243/users/fc5e3cbf1a144153b5ccf56b25915379/roles/9ea7741ab45842faa0bb474f4ee06ed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:30.959270 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:30.959863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:30.959863 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:30.988658 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] MFA Rules not processed for user `fc5e3cbf1a144153b5ccf56b25915379`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:30.989881 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:31.047144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:31.069298 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1439/2872] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:31.083100 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:31.085259 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:31.149831 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dd9f-c5d7-4592-a081-81d0aa3b516b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:31.154413 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:31.155166 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:31.155564 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:31.155880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:31.212516 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:31.213886 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:31.222908 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1434/2873] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:32.586765 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:32.588468 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:32.602186 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ffb6f-47b7-4aa6-8fda-23392440c4c2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:32.606267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:32.606918 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:32.607190 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:32.607475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:32.617160 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:32.618725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:32.629259 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1440/2874] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:41.218882 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:42.625754 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=11 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:45.751055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:45.834820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f46a0-c181-4755-b23a-7c3a91c6f3ba service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:45.840374 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:45.841255 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:45.841525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:45.841870 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] PATH_INFO: `/v3/users/ce7d64591a1949b697ef78147eb79066` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:45.842979 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7d64591a1949b697ef78147eb79066)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:45.844959 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:45.894848 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7d64591a1949b697ef78147eb79066'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:45.895519 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7d64591a1949b697ef78147eb79066'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:45.896541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7d64591a1949b697ef78147eb79066'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:45.909370 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7d64591a1949b697ef78147eb79066'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:45.916540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7d64591a1949b697ef78147eb79066'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:45.930701 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1435/2875] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:45 2022] DELETE /identity/v3/users/ce7d64591a1949b697ef78147eb79066 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:46.119605 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:46.135117 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb359-9753-4a0e-9ed8-4badeae85c05 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:46.198144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:46.199108 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.199437 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.199788 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] PATH_INFO: `/v3/projects/113606bf83374f5a98bbc92638416d92` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.201184 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113606bf83374f5a98bbc92638416d92)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:46.203163 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:46.255662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113606bf83374f5a98bbc92638416d92', 'request_id': 'req-98859731-b784-43a1-b0a4-28d9919fd470'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.262848 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113606bf83374f5a98bbc92638416d92', 'request_id': 'req-98859731-b784-43a1-b0a4-28d9919fd470'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.268519 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113606bf83374f5a98bbc92638416d92', 'request_id': 'req-98859731-b784-43a1-b0a4-28d9919fd470'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.282876 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] The token cache is being invalidate because project 113606bf83374f5a98bbc92638416d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:46.283361 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.284002 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.285612 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1441/2876] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:46 2022] DELETE /identity/v3/projects/113606bf83374f5a98bbc92638416d92 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:46.290525 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:46.292451 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:46.307119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8045-fb71-4206-9b54-5adaf170f033 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:46.369499 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:46.370372 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.370651 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.370915 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] PATH_INFO: `/v3/users/fc5e3cbf1a144153b5ccf56b25915379` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.372146 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5e3cbf1a144153b5ccf56b25915379)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:46.374089 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:46.396130 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:46.427496 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5e3cbf1a144153b5ccf56b25915379'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.428170 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5e3cbf1a144153b5ccf56b25915379'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.429264 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5e3cbf1a144153b5ccf56b25915379'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.442058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5e3cbf1a144153b5ccf56b25915379'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.449820 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-391b76f8-748d-487d-a6f2-8eb0c318453a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5e3cbf1a144153b5ccf56b25915379'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.465068 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1436/2877] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:46 2022] DELETE /identity/v3/users/fc5e3cbf1a144153b5ccf56b25915379 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:46.652427 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:46.654640 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:46.676162 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98859731-b784-43a1-b0a4-28d9919fd470 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:46.739460 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:46.740533 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.741138 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.741458 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] PATH_INFO: `/v3/projects/fd421f6664114d8d9c41769a7aa63243` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.742749 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd421f6664114d8d9c41769a7aa63243)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:46.744937 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:46.787940 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:46.804176 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd421f6664114d8d9c41769a7aa63243', 'request_id': 'req-38a5d983-f3de-4232-a468-f76d2c1dcd48'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.810289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd421f6664114d8d9c41769a7aa63243', 'request_id': 'req-38a5d983-f3de-4232-a468-f76d2c1dcd48'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.816607 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd421f6664114d8d9c41769a7aa63243', 'request_id': 'req-38a5d983-f3de-4232-a468-f76d2c1dcd48'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.831020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] The token cache is being invalidate because project fd421f6664114d8d9c41769a7aa63243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:46.831357 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.832087 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-38a5d983-f3de-4232-a468-f76d2c1dcd48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:46.833718 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1442/2878] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:46 2022] DELETE /identity/v3/projects/fd421f6664114d8d9c41769a7aa63243 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:46.839703 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.840230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.840338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.860841 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:46.862067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:46.923983 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1437/2879] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:46.932469 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.932726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.933032 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.952689 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:46.953913 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:46.962736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1443/2880] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:46.967491 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:46.977852 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb796a66-5102-4d17-95ba-4179f1504390 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:46.982586 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:46.983278 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:46.983574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:46.983842 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:46.984575 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:57:46.984879 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:46.986497 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.003626 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1438/2881] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:57:47.008578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.019115 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142c56-25cd-4ebf-ab51-d6e8c8300507 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.026960 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.028133 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.028636 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.029127 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.030407 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.033475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.061869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1444/2882] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:47 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:47.065794 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.076943 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af790-b00c-4370-a976-da1952489330 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.136011 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.136693 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.137122 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.137407 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.138111 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.140103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.161988 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1439/2883] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:47 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:47.167092 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.177623 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1e37-a5a7-4a36-a4ab-501748689e67 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.182991 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.183530 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.183842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.184101 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.184839 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.186441 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.198245 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1445/2884] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:47.202549 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.213770 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eadae-7f7d-44f3-9d47-943739289f6a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.219228 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.219963 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.220247 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.220504 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.221242 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.222863 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf6da-c1a4-49a0-b6d8-8e684a8d8171 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.235296 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1440/2885] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:47.239373 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.250700 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fc95-ba9e-42e3-901c-9dcbaa8f8f87 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.256148 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.257351 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.257716 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.258000 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] PATH_INFO: `/v3/projects/6a21d93b220b40e6a648048dccb19ca5/users/b0fa51e7699548709a0e01b9c38f7368/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.276025 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a21d93b220b40e6a648048dccb19ca5, user_id=b0fa51e7699548709a0e01b9c38f7368, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.278723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.293823 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1446/2886] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:47 2022] PUT /identity/v3/projects/6a21d93b220b40e6a648048dccb19ca5/users/b0fa51e7699548709a0e01b9c38f7368/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:47.305030 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.305332 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.305623 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.313343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:47.337867 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] MFA Rules not processed for user `b0fa51e7699548709a0e01b9c38f7368`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:47.339113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:47.404785 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1441/2887] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:57:47.416058 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:47.417883 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:47.486054 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6ea6-6073-43a0-bdab-ca6c5af51c82 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:47.490221 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:47.491023 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:47.491308 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:47.491569 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:47.500815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:47.502267 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e6b5c-baa4-47e5-b90e-0eb5493e7180 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:47.512150 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1447/2888] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:56.035398 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:56.098611 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b2442-2cec-4a4a-8f37-4ad22689b283 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:56.103351 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:56.104393 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:56.104671 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:56.104962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] PATH_INFO: `/v3/users/b0fa51e7699548709a0e01b9c38f7368` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:56.106179 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fa51e7699548709a0e01b9c38f7368)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:56.108156 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:56.156620 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fa51e7699548709a0e01b9c38f7368'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.157303 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fa51e7699548709a0e01b9c38f7368'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.157897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fa51e7699548709a0e01b9c38f7368'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.170607 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fa51e7699548709a0e01b9c38f7368'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.177716 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fa51e7699548709a0e01b9c38f7368'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.191543 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1442/2889] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:57:56 2022] DELETE /identity/v3/users/b0fa51e7699548709a0e01b9c38f7368 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:56.196216 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:56.196722 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:56.196830 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:56.214542 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:56.215780 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:56.269774 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:56.280532 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1448/2890] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:56.290746 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:56.292314 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:56.311218 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:56.383097 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d910-bf99-4637-880d-379a141a3890 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:56.387691 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:56.388353 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:56.388633 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:56.388903 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:56.399775 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:56.401343 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda4548-8655-40da-8609-36bc59738f87 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:56.414246 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1443/2891] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:57:56.738112 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:56.739726 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:56.755390 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71792705-7c99-42fe-baeb-17b7ceda1940 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:56.762311 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:56.763243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:56.763585 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:56.763791 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] PATH_INFO: `/v3/projects/6a21d93b220b40e6a648048dccb19ca5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:56.765080 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a21d93b220b40e6a648048dccb19ca5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:56.767020 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:56.824835 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a21d93b220b40e6a648048dccb19ca5', 'request_id': 'req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.831312 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a21d93b220b40e6a648048dccb19ca5', 'request_id': 'req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.837443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a21d93b220b40e6a648048dccb19ca5', 'request_id': 'req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.850884 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] The token cache is being invalidate because project 6a21d93b220b40e6a648048dccb19ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:56.851173 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.851868 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b06198e8-3eb9-4ba8-89c8-8b11d44a60fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:56.853478 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1449/2892] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:57:56 2022] DELETE /identity/v3/projects/6a21d93b220b40e6a648048dccb19ca5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:56.859447 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:56.859767 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:56.860042 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:56.879181 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:56.880431 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:56.943668 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1444/2893] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:57:57.006695 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.006988 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.007258 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.027869 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:57.029062 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:57.037147 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1450/2894] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:57.041710 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.051401 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acba73-35f2-4e1b-912a-a600f1334b30 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.056189 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.056962 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.057240 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.057512 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.058243 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:57:57.058541 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.060215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.072058 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1445/2895] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:57:57.076621 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.086031 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c11a4a-7958-430b-be38-c0792e369d4a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.091710 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.092379 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.092654 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.092919 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.093632 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.095572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.123865 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1451/2896] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:57:57 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:57:57.128183 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.138878 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c513-d33c-46a8-a522-460d6f474a7c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.196347 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.197013 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.197338 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.197588 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.198415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.200389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.220595 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1446/2897] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:57:57 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:57:57.224969 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.236201 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809881-3b6a-48a1-b896-0709e49df2f7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.241403 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.242231 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.242431 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.242701 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.243467 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.245529 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.257677 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1452/2898] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:57:57.262702 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.273540 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ac1a-b2b6-40e2-a5db-b76364b14d0b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.278680 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.279349 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.279675 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.279935 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.280659 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.282276 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff529c9-47bb-47d9-a39f-69c45ba4a5fa admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.292780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1447/2899] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:57:57.297161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.312175 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d35-c51c-452e-8a52-d17649800c40 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.319578 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.320762 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.321081 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.321362 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] PATH_INFO: `/v3/projects/1de7e920eb514ff2be07e558a5295024/users/3da4cf88eb6d4ceea904a0aa84242210/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.337761 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de7e920eb514ff2be07e558a5295024, user_id=3da4cf88eb6d4ceea904a0aa84242210, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.340706 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.356742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1453/2900] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:57:57 2022] PUT /identity/v3/projects/1de7e920eb514ff2be07e558a5295024/users/3da4cf88eb6d4ceea904a0aa84242210/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:57.366826 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.367113 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.367417 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.395507 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] MFA Rules not processed for user `3da4cf88eb6d4ceea904a0aa84242210`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:57.397119 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:57.407230 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:57.466061 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1448/2901] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:57:57.477815 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:57.479786 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:57.538847 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09d9d-fd94-4b81-97db-81060d382d9b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:57.542981 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:57.543581 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:57.543864 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:57.544126 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:57.552757 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:57.554196 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb66c-be83-4440-98b0-4538d3d9646a service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:57.563739 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1454/2902] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:00.141010 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:00.227067 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbf720-e36d-40ec-ab97-a0865567a097 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:00.233208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:00.234086 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:00.234369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:00.234643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] PATH_INFO: `/v3/users/3da4cf88eb6d4ceea904a0aa84242210` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:00.235934 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da4cf88eb6d4ceea904a0aa84242210)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:00.237884 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:00.286614 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da4cf88eb6d4ceea904a0aa84242210'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.287386 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da4cf88eb6d4ceea904a0aa84242210'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.288157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da4cf88eb6d4ceea904a0aa84242210'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.301470 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da4cf88eb6d4ceea904a0aa84242210'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.308975 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da4cf88eb6d4ceea904a0aa84242210'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.326730 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1449/2903] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:58:00 2022] DELETE /identity/v3/users/3da4cf88eb6d4ceea904a0aa84242210 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:00.331398 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:00.331926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:00.332026 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:00.349725 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:00.350941 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:00.367926 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:00.414395 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1455/2904] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:00.424350 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:00.425797 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:00.461880 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:00.490208 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129e95-bc2e-40c3-aa34-b7c153f2fdcb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:00.494204 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:00.494855 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:00.495128 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:00.495397 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:00.504610 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:00.506066 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6390a-d58a-4a27-9a00-4d204b4af9cc service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:00.515649 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1450/2905] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:00.790798 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:00.792490 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:00.807833 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d091e3d-b44d-467d-acea-e3a016cda9a7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:00.812801 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:00.814443 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:00.814732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:00.815004 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] PATH_INFO: `/v3/projects/1de7e920eb514ff2be07e558a5295024` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:00.816321 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de7e920eb514ff2be07e558a5295024)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:00.818210 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:00.869842 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de7e920eb514ff2be07e558a5295024', 'request_id': 'req-aee51458-cae0-4559-b2ed-06479ebd18fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.877236 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de7e920eb514ff2be07e558a5295024', 'request_id': 'req-aee51458-cae0-4559-b2ed-06479ebd18fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.883482 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de7e920eb514ff2be07e558a5295024', 'request_id': 'req-aee51458-cae0-4559-b2ed-06479ebd18fa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.898205 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] The token cache is being invalidate because project 1de7e920eb514ff2be07e558a5295024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:00.898493 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.899124 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aee51458-cae0-4559-b2ed-06479ebd18fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:00.900758 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1456/2906] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:58:00 2022] DELETE /identity/v3/projects/1de7e920eb514ff2be07e558a5295024 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:00.907666 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:00.908099 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:00.908368 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:00.936176 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:00.937419 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:01.004045 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1451/2907] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:01.012348 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.013161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.013161 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.033475 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:01.034694 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:01.043340 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1457/2908] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:01.047916 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.057832 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16433d4-681f-4a92-9220-96fe158cca34 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.062901 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.063562 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.063853 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.064124 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.064859 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:58:01.065157 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.066786 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.079845 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1452/2909] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 26 12:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:58:01.084338 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.094505 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0528-7c32-4e50-9d04-df9c2bf6f7cf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.099992 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.100653 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.100932 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.101289 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.102073 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.104042 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.135736 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1458/2910] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 26 12:58:01 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:01.140055 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.151021 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434960e-7986-4e61-8852-6bc75e8d5b25 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.212117 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.212780 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.213057 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.213331 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.214017 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.216003 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.238636 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1453/2911] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 26 12:58:01 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:01.244105 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.254743 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad747-659e-4a67-af07-31a7d13b1c06 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.260246 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.260911 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.261227 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.261503 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.262397 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.264068 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.275356 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1459/2912] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:01.279608 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.290364 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c5c9-6d6d-4b54-be83-9a7d0c0ad209 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.295897 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.296544 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.296817 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.297060 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.297802 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.299389 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86b8a7-a727-4254-a4d5-bbb76bb41db6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.309844 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1454/2913] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 26 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:01.316301 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.331779 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfc7f6-9191-426c-bb63-d4da6e94f6c9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.339662 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.341009 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.342577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.342577 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] PATH_INFO: `/v3/projects/052692d790754788ada585136ae015c5/users/15f1534b25ce426c8eb85abff82f4c05/roles/68642b462a1f4c3e9599fabc3387b853` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.359144 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] RBAC: Authorizing `identity:create_grant(project_id=052692d790754788ada585136ae015c5, user_id=15f1534b25ce426c8eb85abff82f4c05, role_id=68642b462a1f4c3e9599fabc3387b853)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.361844 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.377976 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1460/2914] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 26 12:58:01 2022] PUT /identity/v3/projects/052692d790754788ada585136ae015c5/users/15f1534b25ce426c8eb85abff82f4c05/roles/68642b462a1f4c3e9599fabc3387b853 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:01.389696 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.389977 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.390251 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.417215 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] MFA Rules not processed for user `15f1534b25ce426c8eb85abff82f4c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:01.418440 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:01.460103 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:01.498869 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1455/2915] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:01.509723 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:01.512732 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:01.567999 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:01.588684 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2a71c-9b4d-4607-b60e-a625072f220d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:01.594657 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df29f2915c446f5b3c0ed3cfb14a89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:01.595622 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:01.595984 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:01.596509 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:01.609396 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:01.611642 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4747de1-561e-439c-ab2c-eac73f12a5fe service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:01.627220 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1461/2916] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:11.495699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=14 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:11.619906 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:12.052505 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:12.126951 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd3bd-7f1e-4e04-88b9-5e90ed48149b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:12.132605 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:12.133508 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.133808 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.134079 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] PATH_INFO: `/v3/users/15f1534b25ce426c8eb85abff82f4c05` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.135415 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f1534b25ce426c8eb85abff82f4c05)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:12.137456 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:12.186437 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f1534b25ce426c8eb85abff82f4c05'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.187206 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f1534b25ce426c8eb85abff82f4c05'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.187917 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f1534b25ce426c8eb85abff82f4c05'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.201428 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f1534b25ce426c8eb85abff82f4c05'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.208811 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f1534b25ce426c8eb85abff82f4c05'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.223235 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1456/2917] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 26 12:58:12 2022] DELETE /identity/v3/users/15f1534b25ce426c8eb85abff82f4c05 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:12.228181 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.228466 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.228742 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.247572 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] MFA Rules not processed for user `801932a0f57f4075beaa7d9bf3b3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:12.248799 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:12.317583 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1462/2918] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 26 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:12.328946 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:12.331448 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:12.410168 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7707520-a3bf-4df4-b53e-b3f0cae6fa24 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:12.414377 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e60332dbea4c4e9e6884f5effd0d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:12.415031 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.415310 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.415622 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.426038 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:12.427574 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:12.437674 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1457/2919] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:12.719668 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:12.721194 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:12.736656 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f8481-4aee-4039-b1f8-6fa1ce39ca21 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:12.741603 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '801932a0f57f4075beaa7d9bf3b3839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7b62d8bc2904e559160e9d978cde596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:12.742484 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.742764 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.743033 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] PATH_INFO: `/v3/projects/052692d790754788ada585136ae015c5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.744316 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052692d790754788ada585136ae015c5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:12.746299 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:12.795082 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052692d790754788ada585136ae015c5', 'request_id': 'req-926df7c4-a61d-4f60-a703-389761c537a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.801296 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052692d790754788ada585136ae015c5', 'request_id': 'req-926df7c4-a61d-4f60-a703-389761c537a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.807972 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052692d790754788ada585136ae015c5', 'request_id': 'req-926df7c4-a61d-4f60-a703-389761c537a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.822243 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] The token cache is being invalidate because project 052692d790754788ada585136ae015c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:12.822531 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.823129 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-926df7c4-a61d-4f60-a703-389761c537a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.824748 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1463/2920] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 26 12:58:12 2022] DELETE /identity/v3/projects/052692d790754788ada585136ae015c5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:22.433336 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:22.819287 dv-cinder-819667-4-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:29.026715 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:02:29.028699 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:29.187974 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d7c5-fd1a-4c79-81eb-f47979fc4185 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:02:29.263925 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce69c247da4f47a3baaf1126891a70e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf78e40dc914e49a59f8c8fd372a5c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:02:29.264645 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:02:29.264965 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:02:29.265369 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:02:29.267676 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:29.282643 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:02:29.284328 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70dca4-402d-4d81-9390-677cd0e3253d service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:02:29.296253 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1458/2921] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 26 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:02:39.291145 dv-cinder-819667-4-iscsi devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}